American Osteopathic Association Yearbook 2005 & 2006

home *** CD-ROM | disk | FTP | other *** search
/ American Osteopathic Ass…tion Yearbook 2005 & 2006 / American Osteopathic Association Yearbook 2005 & 2006.iso / mac / app / tokenize.pyc < prev next >
Unknown | 2004-07-22 | 11.5 KB
open in:
MacOS 8.1 |
Win98 |
DOS
view JSON data |
view as text

This file was not able to be converted.
This format is not currently supported by dexvert.
Confidence	Program	Detection	Match Type	Support
`100%`	dexvert	Python Compiled Bytecode `(document/pythonCompiled)`	magic	Supported
`100%`	file	python 2.3 byte-compiled	default
`99%`	file	data	default
`100%`	TrID	Python optimized code	default
`100%`	siegfried	fmt/1109 Python Compiled File (2.3)	default
`100%`	gt2	Kompilierter Phyton Source Code	default
`100%`	detectItEasy	Format: Python Compiled Module(2.3a0)	default
hex view
+--------+-------------------------+-------------------------+--------+--------+
|00000000| 3b f2 0d 0a 00 00 00 00 | 63 00 00 00 00 00 00 00 |;.......|c.......|
|00000010| 00 12 00 00 00 40 00 00 | 00 73 fd 04 00 00 64 00 |.....@..|.s....d.|
|00000020| 00 5a 00 00 64 01 00 5a | 01 00 64 02 00 5a 02 00 |.Z..d..Z|..d..Z..|
|00000030| 64 03 00 6b 03 00 5a 03 | 00 64 03 00 6b 04 00 5a |d..k..Z.|.d..k..Z|
|00000040| 04 00 64 04 00 6b 05 00 | 54 64 03 00 6b 05 00 5a |..d..k..|Td..k..Z|
|00000050| 05 00 67 00 00 04 69 06 | 00 5a 07 00 65 08 00 65 |..g...i.|.Z..e..e|
|00000060| 05 00 83 01 00 44 5d 25 | 00 5a 09 00 65 09 00 64 |.....D]%|.Z..e..d|
|00000070| 05 00 19 64 06 00 6a 03 | 00 6f 0e 00 01 65 07 00 |...d..j.|.o...e..|
|00000080| 65 09 00 83 01 00 01 71 | 48 00 01 71 48 00 5b 07 |e......q|H..qH.[.|
|00000090| 00 64 07 00 64 08 00 64 | 09 00 64 0a 00 67 04 00 |.d..d..d|..d..g..|
|000000a0| 17 5a 0a 00 5b 09 00 5b | 05 00 65 0b 00 5a 0c 00 |.Z..[..[|..e..Z..|
|000000b0| 64 07 00 65 0d 00 65 0c | 00 3c 65 0b 00 64 0b 00 |d..e..e.|.<e..d..|
|000000c0| 17 5a 0e 00 64 0a 00 65 | 0d 00 65 0e 00 3c 65 0b |.Z..d..e|..e..<e.|
|000000d0| 00 64 0c 00 37 5a 0b 00 | 64 0d 00 84 00 00 5a 0f |.d..7Z..|d.....Z.|
|000000e0| 00 64 0e 00 84 00 00 5a | 10 00 64 0f 00 84 00 00 |.d.....Z|..d.....|
|000000f0| 5a 11 00 64 10 00 5a 12 | 00 64 11 00 5a 13 00 65 |Z..d..Z.|.d..Z..e|
|00000100| 12 00 65 10 00 64 12 00 | 65 12 00 17 83 01 00 17 |..e..d..|e.......|
|00000110| 65 11 00 65 13 00 83 01 | 00 17 5a 14 00 64 13 00 |e..e....|..Z..d..|
|00000120| 5a 15 00 64 14 00 5a 16 | 00 64 15 00 5a 17 00 64 |Z..d..Z.|.d..Z..d|
|00000130| 16 00 5a 18 00 65 0f 00 | 65 16 00 65 17 00 65 18 |..Z..e..|e..e..e.|
|00000140| 00 83 03 00 5a 19 00 64 | 17 00 5a 1a 00 65 0f 00 |....Z..d|..Z..e..|
|00000150| 64 18 00 64 19 00 83 02 | 00 65 11 00 65 1a 00 83 |d..d....|.e..e...|
|00000160| 01 00 17 5a 1b 00 64 1a | 00 65 1a 00 17 5a 1c 00 |...Z..d.|.e...Z..|
|00000170| 65 0f 00 65 1b 00 65 1c | 00 83 02 00 5a 1d 00 65 |e..e..e.|....Z..e|
|00000180| 0f 00 64 1b 00 65 1d 00 | 64 1c 00 17 83 02 00 5a |..d..e..|d......Z|
|00000190| 1e 00 65 0f 00 65 1e 00 | 65 1d 00 65 19 00 83 03 |..e..e..|e..e....|
|000001a0| 00 5a 1f 00 64 1d 00 5a | 20 00 64 1e 00 5a 21 00 |.Z..d..Z| .d..Z!.|
|000001b0| 64 1f 00 5a 22 00 64 20 | 00 5a 23 00 65 0f 00 64 |d..Z".d |.Z#.e..d|
|000001c0| 21 00 64 22 00 83 02 00 | 5a 24 00 65 0f 00 64 23 |!.d"....|Z$.e..d#|
|000001d0| 00 64 24 00 83 02 00 5a | 25 00 65 0f 00 64 25 00 |.d$....Z|%.e..d%.|
|000001e0| 64 26 00 64 27 00 64 28 | 00 64 29 00 64 2a 00 64 |d&.d'.d(|.d).d*.d|
|000001f0| 2b 00 64 2c 00 83 08 00 | 5a 26 00 64 2d 00 5a 27 |+.d,....|Z&.d-.Z'|
|00000200| 00 65 0f 00 64 2e 00 64 | 2f 00 83 02 00 5a 28 00 |.e..d..d|/....Z(.|
|00000210| 65 0f 00 65 26 00 65 27 | 00 65 28 00 83 03 00 5a |e..e&.e'|.e(....Z|
|00000220| 29 00 65 0f 00 65 1f 00 | 65 29 00 65 25 00 65 15 |).e..e..|e).e%.e.|
|00000230| 00 83 04 00 5a 2a 00 65 | 14 00 65 2a 00 17 5a 2b |....Z*.e|..e*..Z+|
|00000240| 00 65 0f 00 64 30 00 65 | 0f 00 64 31 00 64 12 00 |.e..d0.e|..d1.d..|
|00000250| 83 02 00 17 64 32 00 65 | 0f 00 64 33 00 64 12 00 |....d2.e|..d3.d..|
|00000260| 83 02 00 17 83 02 00 5a | 2c 00 65 0f 00 64 12 00 |.......Z|,.e..d..|
|00000270| 65 13 00 65 24 00 83 03 | 00 5a 2d 00 65 12 00 65 |e..e$...|.Z-.e..e|
|00000280| 0f 00 65 2d 00 65 1f 00 | 65 29 00 65 2c 00 65 15 |..e-.e..|e).e,.e.|
|00000290| 00 83 05 00 17 5a 2e 00 | 65 2f 00 65 04 00 69 30 |.....Z..|e/.e..i0|
|000002a0| 00 65 2b 00 65 2e 00 65 | 22 00 65 23 00 66 04 00 |.e+.e..e|".e#.f..|
|000002b0| 83 02 00 5c 04 00 5a 31 | 00 5a 32 00 5a 33 00 5a |...\..Z1|.Z2.Z3.Z|
|000002c0| 34 00 68 00 00 04 64 31 | 00 65 04 00 69 30 00 65 |4.h...d1|.e..i0.e|
|000002d0| 20 00 83 01 00 03 3c 04 | 64 33 00 65 04 00 69 30 | .....<.|d3.e..i0|
|000002e0| 00 65 21 00 83 01 00 03 | 3c 04 64 34 00 65 33 00 |.e!.....|<.d4.e3.|
|000002f0| 03 3c 04 64 35 00 65 34 | 00 03 3c 04 64 36 00 65 |.<.d5.e4|..<.d6.e|
|00000300| 33 00 03 3c 04 64 37 00 | 65 34 00 03 3c 04 64 38 |3..<.d7.|e4..<.d8|
|00000310| 00 65 33 00 03 3c 04 64 | 39 00 65 34 00 03 3c 04 |.e3..<.d|9.e4..<.|
|00000320| 64 3a 00 65 33 00 03 3c | 04 64 3b 00 65 34 00 03 |d:.e3..<|.d;.e4..|
|00000330| 3c 04 64 3c 00 65 33 00 | 03 3c 04 64 3d 00 65 34 |<.d<.e3.|.<.d=.e4|
|00000340| 00 03 3c 04 64 3e 00 65 | 33 00 03 3c 04 64 3f 00 |..<.d>.e|3..<.d?.|
|00000350| 65 34 00 03 3c 04 64 40 | 00 65 33 00 03 3c 04 64 |e4..<.d@|.e3..<.d|
|00000360| 41 00 65 34 00 03 3c 04 | 64 42 00 65 33 00 03 3c |A.e4..<.|dB.e3..<|
|00000370| 04 64 43 00 65 34 00 03 | 3c 04 64 44 00 65 33 00 |.dC.e4..|<.dD.e3.|
|00000380| 03 3c 04 64 45 00 65 34 | 00 03 3c 04 64 46 00 65 |.<.dE.e4|..<.dF.e|
|00000390| 35 00 03 3c 04 64 47 00 | 65 35 00 03 3c 04 64 48 |5..<.dG.|e5..<.dH|
|000003a0| 00 65 35 00 03 3c 04 64 | 49 00 65 35 00 03 3c 5a |.e5..<.d|I.e5..<Z|
|000003b0| 36 00 68 00 00 5a 37 00 | 78 4e 00 64 34 00 64 35 |6.h..Z7.|xN.d4.d5|
|000003c0| 00 64 36 00 64 37 00 64 | 3c 00 64 3d 00 64 38 00 |.d6.d7.d|<.d=.d8.|
|000003d0| 64 39 00 64 3e 00 64 3f | 00 64 3a 00 64 3b 00 64 |d9.d>.d?|.d:.d;.d|
|000003e0| 42 00 64 43 00 64 40 00 | 64 41 00 64 44 00 64 45 |B.dC.d@.|dA.dD.dE|
|000003f0| 00 66 12 00 44 5d 10 00 | 5a 38 00 65 38 00 65 37 |.f..D]..|Z8.e8.e7|
|00000400| 00 65 38 00 3c 71 d7 03 | 57 68 00 00 5a 39 00 78 |.e8.<q..|Wh..Z9.x|
|00000410| 4e 00 64 31 00 64 33 00 | 64 4a 00 64 4b 00 64 4c |N.d1.d3.|dJ.dK.dL|
|00000420| 00 64 4d 00 64 4e 00 64 | 4f 00 64 50 00 64 51 00 |.dM.dN.d|O.dP.dQ.|
|00000430| 64 52 00 64 53 00 64 54 | 00 64 55 00 64 56 00 64 |dR.dS.dT|.dU.dV.d|
|00000440| 57 00 64 58 00 64 59 00 | 66 12 00 44 5d 10 00 5a |W.dX.dY.|f..D]..Z|
|00000450| 38 00 65 38 00 65 39 00 | 65 38 00 3c 71 2e 04 57 |8.e8.e9.|e8.<q..W|
|00000460| 64 5a 00 5a 3a 00 64 5b | 00 65 3b 00 66 01 00 64 |dZ.Z:.d[|.e;.f..d|
|00000470| 5c 00 84 00 00 83 00 00 | 59 5a 3c 00 64 5d 00 65 |\.......|YZ<.d].e|
|00000480| 3b 00 66 01 00 64 5e 00 | 84 00 00 83 00 00 59 5a |;.f..d^.|......YZ|
|00000490| 3d 00 64 5f 00 84 00 00 | 5a 3e 00 65 3e 00 64 60 |=.d_....|Z>.e>.d`|
|000004a0| 00 84 01 00 5a 3f 00 64 | 61 00 84 00 00 5a 40 00 |....Z?.d|a....Z@.|
|000004b0| 64 62 00 84 00 00 5a 41 | 00 65 42 00 64 63 00 6a |db....ZA|.eB.dc.j|
|000004c0| 02 00 6f 51 00 01 64 03 | 00 6b 43 00 5a 43 00 65 |..oQ..d.|.kC.ZC.e|
|000004d0| 44 00 65 43 00 69 45 00 | 83 01 00 64 0b 00 6a 04 |D.eC.iE.|...d..j.|
|000004e0| 00 6f 1e 00 01 65 3f 00 | 65 46 00 65 43 00 69 45 |.o...e?.|eF.eC.iE|
|000004f0| 00 64 0b 00 19 83 01 00 | 69 47 00 83 01 00 01 71 |.d......|iG.....q|
|00000500| f9 04 01 65 3f 00 65 43 | 00 69 48 00 69 47 00 83 |...e?.eC|.iH.iG..|
|00000510| 01 00 01 6e 01 00 01 64 | 03 00 53 28 64 00 00 00 |...n...d|..S(d...|
|00000520| 73 c0 03 00 00 54 6f 6b | 65 6e 69 7a 61 74 69 6f |s....Tok|enizatio|
|00000530| 6e 20 68 65 6c 70 20 66 | 6f 72 20 50 79 74 68 6f |n help f|or Pytho|
|00000540| 6e 20 70 72 6f 67 72 61 | 6d 73 2e 0a 0a 67 65 6e |n progra|ms...gen|
|00000550| 65 72 61 74 65 5f 74 6f | 6b 65 6e 73 28 72 65 61 |erate_to|kens(rea|
|00000560| 64 6c 69 6e 65 29 20 69 | 73 20 61 20 67 65 6e 65 |dline) i|s a gene|
|00000570| 72 61 74 6f 72 20 74 68 | 61 74 20 62 72 65 61 6b |rator th|at break|
|00000580| 73 20 61 20 73 74 72 65 | 61 6d 20 6f 66 0a 74 65 |s a stre|am of.te|
|00000590| 78 74 20 69 6e 74 6f 20 | 50 79 74 68 6f 6e 20 74 |xt into |Python t|
|000005a0| 6f 6b 65 6e 73 2e 20 20 | 49 74 20 61 63 63 65 70 |okens.  |It accep|
|000005b0| 74 73 20 61 20 72 65 61 | 64 6c 69 6e 65 2d 6c 69 |ts a rea|dline-li|
|000005c0| 6b 65 20 6d 65 74 68 6f | 64 20 77 68 69 63 68 20 |ke metho|d which |
|000005d0| 69 73 20 63 61 6c 6c 65 | 64 0a 72 65 70 65 61 74 |is calle|d.repeat|
|000005e0| 65 64 6c 79 20 74 6f 20 | 67 65 74 20 74 68 65 20 |edly to |get the |
|000005f0| 6e 65 78 74 20 6c 69 6e | 65 20 6f 66 20 69 6e 70 |next lin|e of inp|
|00000600| 75 74 20 28 6f 72 20 22 | 22 20 66 6f 72 20 45 4f |ut (or "|" for EO|
|00000610| 46 29 2e 20 20 49 74 20 | 67 65 6e 65 72 61 74 65 |F).  It |generate|
|00000620| 73 0a 35 2d 74 75 70 6c | 65 73 20 77 69 74 68 20 |s.5-tupl|es with |
|00000630| 74 68 65 73 65 20 6d 65 | 6d 62 65 72 73 3a 0a 0a |these me|mbers:..|
|00000640| 20 20 20 20 74 68 65 20 | 74 6f 6b 65 6e 20 74 79 |    the |token ty|
|00000650| 70 65 20 28 73 65 65 20 | 74 6f 6b 65 6e 2e 70 79 |pe (see |token.py|
|00000660| 29 0a 20 20 20 20 74 68 | 65 20 74 6f 6b 65 6e 20 |).    th|e token |
|00000670| 28 61 20 73 74 72 69 6e | 67 29 0a 20 20 20 20 74 |(a strin|g).    t|
|00000680| 68 65 20 73 74 61 72 74 | 69 6e 67 20 28 72 6f 77 |he start|ing (row|
|00000690| 2c 20 63 6f 6c 75 6d 6e | 29 20 69 6e 64 69 63 65 |, column|) indice|
|000006a0| 73 20 6f 66 20 74 68 65 | 20 74 6f 6b 65 6e 20 28 |s of the| token (|
|000006b0| 61 20 32 2d 74 75 70 6c | 65 20 6f 66 20 69 6e 74 |a 2-tupl|e of int|
|000006c0| 73 29 0a 20 20 20 20 74 | 68 65 20 65 6e 64 69 6e |s).    t|he endin|
|000006d0| 67 20 28 72 6f 77 2c 20 | 63 6f 6c 75 6d 6e 29 20 |g (row, |column) |
|000006e0| 69 6e 64 69 63 65 73 20 | 6f 66 20 74 68 65 20 74 |indices |of the t|
|000006f0| 6f 6b 65 6e 20 28 61 20 | 32 2d 74 75 70 6c 65 20 |oken (a |2-tuple |
|00000700| 6f 66 20 69 6e 74 73 29 | 0a 20 20 20 20 74 68 65 |of ints)|.    the|
|00000710| 20 6f 72 69 67 69 6e 61 | 6c 20 6c 69 6e 65 20 28 | origina|l line (|
|00000720| 73 74 72 69 6e 67 29 0a | 0a 49 74 20 69 73 20 64 |string).|.It is d|
|00000730| 65 73 69 67 6e 65 64 20 | 74 6f 20 6d 61 74 63 68 |esigned |to match|
|00000740| 20 74 68 65 20 77 6f 72 | 6b 69 6e 67 20 6f 66 20 | the wor|king of |
|00000750| 74 68 65 20 50 79 74 68 | 6f 6e 20 74 6f 6b 65 6e |the Pyth|on token|
|00000760| 69 7a 65 72 20 65 78 61 | 63 74 6c 79 2c 20 65 78 |izer exa|ctly, ex|
|00000770| 63 65 70 74 0a 74 68 61 | 74 20 69 74 20 70 72 6f |cept.tha|t it pro|
|00000780| 64 75 63 65 73 20 43 4f | 4d 4d 45 4e 54 20 74 6f |duces CO|MMENT to|
|00000790| 6b 65 6e 73 20 66 6f 72 | 20 63 6f 6d 6d 65 6e 74 |kens for| comment|
|000007a0| 73 20 61 6e 64 20 67 69 | 76 65 73 20 74 79 70 65 |s and gi|ves type|
|000007b0| 20 4f 50 20 66 6f 72 20 | 61 6c 6c 0a 6f 70 65 72 | OP for |all.oper|
|000007c0| 61 74 6f 72 73 0a 0a 4f | 6c 64 65 72 20 65 6e 74 |ators..O|lder ent|
|000007d0| 72 79 20 70 6f 69 6e 74 | 73 0a 20 20 20 20 74 6f |ry point|s.    to|
|000007e0| 6b 65 6e 69 7a 65 5f 6c | 6f 6f 70 28 72 65 61 64 |kenize_l|oop(read|
|000007f0| 6c 69 6e 65 2c 20 74 6f | 6b 65 6e 65 61 74 65 72 |line, to|keneater|
|00000800| 29 0a 20 20 20 20 74 6f | 6b 65 6e 69 7a 65 28 72 |).    to|kenize(r|
|00000810| 65 61 64 6c 69 6e 65 2c | 20 74 6f 6b 65 6e 65 61 |eadline,| tokenea|
|00000820| 74 65 72 3d 70 72 69 6e | 74 74 6f 6b 65 6e 29 0a |ter=prin|ttoken).|
|00000830| 61 72 65 20 74 68 65 20 | 73 61 6d 65 2c 20 65 78 |are the |same, ex|
|00000840| 63 65 70 74 20 69 6e 73 | 74 65 61 64 20 6f 66 20 |cept ins|tead of |
|00000850| 67 65 6e 65 72 61 74 69 | 6e 67 20 74 6f 6b 65 6e |generati|ng token|
|00000860| 73 2c 20 74 6f 6b 65 6e | 65 61 74 65 72 20 69 73 |s, token|eater is|
|00000870| 20 61 20 63 61 6c 6c 62 | 61 63 6b 0a 66 75 6e 63 | a callb|ack.func|
|00000880| 74 69 6f 6e 20 74 6f 20 | 77 68 69 63 68 20 74 68 |tion to |which th|
|00000890| 65 20 35 20 66 69 65 6c | 64 73 20 64 65 73 63 72 |e 5 fiel|ds descr|
|000008a0| 69 62 65 64 20 61 62 6f | 76 65 20 61 72 65 20 70 |ibed abo|ve are p|
|000008b0| 61 73 73 65 64 20 61 73 | 20 35 20 61 72 67 75 6d |assed as| 5 argum|
|000008c0| 65 6e 74 73 2c 0a 65 61 | 63 68 20 74 69 6d 65 20 |ents,.ea|ch time |
|000008d0| 61 20 6e 65 77 20 74 6f | 6b 65 6e 20 69 73 20 66 |a new to|ken is f|
|000008e0| 6f 75 6e 64 2e 73 1a 00 | 00 00 4b 61 2d 50 69 6e |ound.s..|..Ka-Pin|
|000008f0| 67 20 59 65 65 20 3c 70 | 69 6e 67 40 6c 66 77 2e |g Yee <p|ing@lfw.|
|00000900| 6f 72 67 3e 73 40 00 00 | 00 47 76 52 2c 20 45 53 |org>s@..|.GvR, ES|
|00000910| 52 2c 20 54 69 6d 20 50 | 65 74 65 72 73 2c 20 54 |R, Tim P|eters, T|
|00000920| 68 6f 6d 61 73 20 57 6f | 75 74 65 72 73 2c 20 46 |homas Wo|uters, F|
|00000930| 72 65 64 20 44 72 61 6b | 65 2c 20 53 6b 69 70 20 |red Drak|e, Skip |
|00000940| 4d 6f 6e 74 61 6e 61 72 | 6f 4e 28 01 00 00 00 73 |Montanar|oN(....s|
|00000950| 01 00 00 00 2a 69 00 00 | 00 00 73 01 00 00 00 5f |....*i..|..s...._|
|00000960| 73 07 00 00 00 43 4f 4d | 4d 45 4e 54 73 08 00 00 |s....COM|MENTs...|
|00000970| 00 74 6f 6b 65 6e 69 7a | 65 73 0f 00 00 00 67 65 |.tokeniz|es....ge|
|00000980| 6e 65 72 61 74 65 5f 74 | 6f 6b 65 6e 73 73 02 00 |nerate_t|okenss..|
|00000990| 00 00 4e 4c 69 01 00 00 | 00 69 02 00 00 00 63 00 |..NLi...|.i....c.|
|000009a0| 00 00 00 01 00 00 00 03 | 00 00 00 47 00 00 00 73 |........|...G...s|
|000009b0| 19 00 00 00 64 01 00 64 | 02 00 69 00 00 7c 00 00 |....d..d|..i..|..|
|000009c0| 83 01 00 17 64 03 00 17 | 53 64 00 00 53 28 04 00 |....d...|Sd..S(..|
|000009d0| 00 00 4e 73 01 00 00 00 | 28 73 01 00 00 00 7c 73 |..Ns....|(s....|s|
|000009e0| 01 00 00 00 29 28 02 00 | 00 00 73 04 00 00 00 6a |....)(..|..s....j|
|000009f0| 6f 69 6e 73 07 00 00 00 | 63 68 6f 69 63 65 73 28 |oins....|choices(|
|00000a00| 01 00 00 00 73 07 00 00 | 00 63 68 6f 69 63 65 73 |....s...|.choices|
|00000a10| 28 00 00 00 00 28 00 00 | 00 00 73 4b 00 00 00 2f |(....(..|..sK.../|
|00000a20| 4c 69 62 72 61 72 79 2f | 46 72 61 6d 65 77 6f 72 |Library/|Framewor|
|00000a30| 6b 73 2f 50 79 74 68 6f | 6e 2e 66 72 61 6d 65 77 |ks/Pytho|n.framew|
|00000a40| 6f 72 6b 2f 56 65 72 73 | 69 6f 6e 73 2f 32 2e 33 |ork/Vers|ions/2.3|
|00000a50| 2f 6c 69 62 2f 70 79 74 | 68 6f 6e 32 2e 33 2f 74 |/lib/pyt|hon2.3/t|
|00000a60| 6f 6b 65 6e 69 7a 65 2e | 70 79 73 05 00 00 00 67 |okenize.|pys....g|
|00000a70| 72 6f 75 70 2c 00 00 00 | 73 00 00 00 00 63 00 00 |roup,...|s....c..|
|00000a80| 00 00 01 00 00 00 02 00 | 00 00 47 00 00 00 73 12 |........|..G...s.|
|00000a90| 00 00 00 74 00 00 7c 00 | 00 8c 00 00 64 01 00 17 |...t..|.|....d...|
|00000aa0| 53 64 00 00 53 28 02 00 | 00 00 4e 73 01 00 00 00 |Sd..S(..|..Ns....|
|00000ab0| 2a 28 02 00 00 00 73 05 | 00 00 00 67 72 6f 75 70 |*(....s.|...group|
|00000ac0| 73 07 00 00 00 63 68 6f | 69 63 65 73 28 01 00 00 |s....cho|ices(...|
|00000ad0| 00 73 07 00 00 00 63 68 | 6f 69 63 65 73 28 00 00 |.s....ch|oices(..|
|00000ae0| 00 00 28 00 00 00 00 73 | 4b 00 00 00 2f 4c 69 62 |..(....s|K.../Lib|
|00000af0| 72 61 72 79 2f 46 72 61 | 6d 65 77 6f 72 6b 73 2f |rary/Fra|meworks/|
|00000b00| 50 79 74 68 6f 6e 2e 66 | 72 61 6d 65 77 6f 72 6b |Python.f|ramework|
|00000b10| 2f 56 65 72 73 69 6f 6e | 73 2f 32 2e 33 2f 6c 69 |/Version|s/2.3/li|
|00000b20| 62 2f 70 79 74 68 6f 6e | 32 2e 33 2f 74 6f 6b 65 |b/python|2.3/toke|
|00000b30| 6e 69 7a 65 2e 70 79 73 | 03 00 00 00 61 6e 79 2d |nize.pys|....any-|
|00000b40| 00 00 00 73 00 00 00 00 | 63 00 00 00 00 01 00 00 |...s....|c.......|
|00000b50| 00 02 00 00 00 47 00 00 | 00 73 12 00 00 00 74 00 |.....G..|.s....t.|
|00000b60| 00 7c 00 00 8c 00 00 64 | 01 00 17 53 64 00 00 53 |.|.....d|...Sd..S|
|00000b70| 28 02 00 00 00 4e 73 01 | 00 00 00 3f 28 02 00 00 |(....Ns.|...?(...|
|00000b80| 00 73 05 00 00 00 67 72 | 6f 75 70 73 07 00 00 00 |.s....gr|oups....|
|00000b90| 63 68 6f 69 63 65 73 28 | 01 00 00 00 73 07 00 00 |choices(|....s...|
|00000ba0| 00 63 68 6f 69 63 65 73 | 28 00 00 00 00 28 00 00 |.choices|(....(..|
|00000bb0| 00 00 73 4b 00 00 00 2f | 4c 69 62 72 61 72 79 2f |..sK.../|Library/|
|00000bc0| 46 72 61 6d 65 77 6f 72 | 6b 73 2f 50 79 74 68 6f |Framewor|ks/Pytho|
|00000bd0| 6e 2e 66 72 61 6d 65 77 | 6f 72 6b 2f 56 65 72 73 |n.framew|ork/Vers|
|00000be0| 69 6f 6e 73 2f 32 2e 33 | 2f 6c 69 62 2f 70 79 74 |ions/2.3|/lib/pyt|
|00000bf0| 68 6f 6e 32 2e 33 2f 74 | 6f 6b 65 6e 69 7a 65 2e |hon2.3/t|okenize.|
|00000c00| 70 79 73 05 00 00 00 6d | 61 79 62 65 2e 00 00 00 |pys....m|aybe....|
|00000c10| 73 00 00 00 00 73 08 00 | 00 00 5b 20 5c 66 5c 74 |s....s..|..[ \f\t|
|00000c20| 5d 2a 73 09 00 00 00 23 | 5b 5e 5c 72 5c 6e 5d 2a |]*s....#|[^\r\n]*|
|00000c30| 73 07 00 00 00 5c 5c 5c | 72 3f 5c 6e 73 0c 00 00 |s....\\\|r?\ns...|
|00000c40| 00 5b 61 2d 7a 41 2d 5a | 5f 5d 5c 77 2a 73 15 00 |.[a-zA-Z|_]\w*s..|
|00000c50| 00 00 30 5b 78 58 5d 5b | 5c 64 61 2d 66 41 2d 46 |..0[xX][|\da-fA-F|
|00000c60| 5d 2a 5b 6c 4c 5d 3f 73 | 0c 00 00 00 30 5b 30 2d |]*[lL]?s|....0[0-|
|00000c70| 37 5d 2a 5b 6c 4c 5d 3f | 73 0d 00 00 00 5b 31 2d |7]*[lL]?|s....[1-|
|00000c80| 39 5d 5c 64 2a 5b 6c 4c | 5d 3f 73 0c 00 00 00 5b |9]\d*[lL|]?s....[|
|00000c90| 65 45 5d 5b 2d 2b 5d 3f | 5c 64 2b 73 08 00 00 00 |eE][-+]?|\d+s....|
|00000ca0| 5c 64 2b 5c 2e 5c 64 2a | 73 05 00 00 00 5c 2e 5c |\d+\.\d*|s....\.\|
|00000cb0| 64 2b 73 03 00 00 00 5c | 64 2b 73 07 00 00 00 5c |d+s....\|d+s....\|
|00000cc0| 64 2b 5b 6a 4a 5d 73 04 | 00 00 00 5b 6a 4a 5d 73 |d+[jJ]s.|...[jJ]s|
|00000cd0| 17 00 00 00 5b 5e 27 5c | 5c 5d 2a 28 3f 3a 5c 5c |....[^'\|\]*(?:\\|
|00000ce0| 2e 5b 5e 27 5c 5c 5d 2a | 29 2a 27 73 17 00 00 00 |.[^'\\]*|)*'s....|
|00000cf0| 5b 5e 22 5c 5c 5d 2a 28 | 3f 3a 5c 5c 2e 5b 5e 22 |[^"\\]*(|?:\\.[^"|
|00000d00| 5c 5c 5d 2a 29 2a 22 73 | 25 00 00 00 5b 5e 27 5c |\\]*)*"s|%...[^'\|
|00000d10| 5c 5d 2a 28 3f 3a 28 3f | 3a 5c 5c 2e 7c 27 28 3f |\]*(?:(?|:\\.|'(?|
|00000d20| 21 27 27 29 29 5b 5e 27 | 5c 5c 5d 2a 29 2a 27 27 |!''))[^'|\\]*)*''|
|00000d30| 27 73 25 00 00 00 5b 5e | 22 5c 5c 5d 2a 28 3f 3a |'s%...[^|"\\]*(?:|
|00000d40| 28 3f 3a 5c 5c 2e 7c 22 | 28 3f 21 22 22 29 29 5b |(?:\\.|"|(?!""))[|
|00000d50| 5e 22 5c 5c 5d 2a 29 2a | 22 22 22 73 0d 00 00 00 |^"\\]*)*|"""s....|
|00000d60| 5b 75 55 5d 3f 5b 72 52 | 5d 3f 27 27 27 73 0d 00 |[uU]?[rR|]?'''s..|
|00000d70| 00 00 5b 75 55 5d 3f 5b | 72 52 5d 3f 22 22 22 73 |..[uU]?[|rR]?"""s|
|00000d80| 26 00 00 00 5b 75 55 5d | 3f 5b 72 52 5d 3f 27 5b |&...[uU]|?[rR]?'[|
|00000d90| 5e 5c 6e 27 5c 5c 5d 2a | 28 3f 3a 5c 5c 2e 5b 5e |^\n'\\]*|(?:\\.[^|
|00000da0| 5c 6e 27 5c 5c 5d 2a 29 | 2a 27 73 26 00 00 00 5b |\n'\\]*)|*'s&...[|
|00000db0| 75 55 5d 3f 5b 72 52 5d | 3f 22 5b 5e 5c 6e 22 5c |uU]?[rR]|?"[^\n"\|
|00000dc0| 5c 5d 2a 28 3f 3a 5c 5c | 2e 5b 5e 5c 6e 22 5c 5c |\]*(?:\\|.[^\n"\\|
|00000dd0| 5d 2a 29 2a 22 73 06 00 | 00 00 5c 2a 5c 2a 3d 3f |]*)*"s..|..\*\*=?|
|00000de0| 73 04 00 00 00 3e 3e 3d | 3f 73 04 00 00 00 3c 3c |s....>>=|?s....<<|
|00000df0| 3d 3f 73 02 00 00 00 3c | 3e 73 02 00 00 00 21 3d |=?s....<|>s....!=|
|00000e00| 73 04 00 00 00 2f 2f 3d | 3f 73 10 00 00 00 5b 2b |s....//=|?s....[+|
|00000e10| 5c 2d 2a 2f 25 26 7c 5e | 3d 3c 3e 5d 3d 3f 73 01 |\-*/%&|^|=<>]=?s.|
|00000e20| 00 00 00 7e 73 08 00 00 | 00 5b 5d 5b 28 29 7b 7d |...~s...|.[][(){}|
|00000e30| 5d 73 05 00 00 00 5c 72 | 3f 5c 6e 73 07 00 00 00 |]s....\r|?\ns....|
|00000e40| 5b 3a 3b 2e 2c 60 5d 73 | 25 00 00 00 5b 75 55 5d |[:;.,`]s|%...[uU]|
|00000e50| 3f 5b 72 52 5d 3f 27 5b | 5e 5c 6e 27 5c 5c 5d 2a |?[rR]?'[|^\n'\\]*|
|00000e60| 28 3f 3a 5c 5c 2e 5b 5e | 5c 6e 27 5c 5c 5d 2a 29 |(?:\\.[^|\n'\\]*)|
|00000e70| 2a 73 01 00 00 00 27 73 | 25 00 00 00 5b 75 55 5d |*s....'s|%...[uU]|
|00000e80| 3f 5b 72 52 5d 3f 22 5b | 5e 5c 6e 22 5c 5c 5d 2a |?[rR]?"[|^\n"\\]*|
|00000e90| 28 3f 3a 5c 5c 2e 5b 5e | 5c 6e 22 5c 5c 5d 2a 29 |(?:\\.[^|\n"\\]*)|
|00000ea0| 2a 73 01 00 00 00 22 73 | 03 00 00 00 27 27 27 73 |*s...."s|....'''s|
|00000eb0| 03 00 00 00 22 22 22 73 | 04 00 00 00 72 27 27 27 |...."""s|....r'''|
|00000ec0| 73 04 00 00 00 72 22 22 | 22 73 04 00 00 00 75 27 |s....r""|"s....u'|
|00000ed0| 27 27 73 04 00 00 00 75 | 22 22 22 73 05 00 00 00 |''s....u|"""s....|
|00000ee0| 75 72 27 27 27 73 05 00 | 00 00 75 72 22 22 22 73 |ur'''s..|..ur"""s|
|00000ef0| 04 00 00 00 52 27 27 27 | 73 04 00 00 00 52 22 22 |....R'''|s....R""|
|00000f00| 22 73 04 00 00 00 55 27 | 27 27 73 04 00 00 00 55 |"s....U'|''s....U|
|00000f10| 22 22 22 73 05 00 00 00 | 75 52 27 27 27 73 05 00 |"""s....|uR'''s..|
|00000f20| 00 00 75 52 22 22 22 73 | 05 00 00 00 55 72 27 27 |..uR"""s|....Ur''|
|00000f30| 27 73 05 00 00 00 55 72 | 22 22 22 73 05 00 00 00 |'s....Ur|"""s....|
|00000f40| 55 52 27 27 27 73 05 00 | 00 00 55 52 22 22 22 73 |UR'''s..|..UR"""s|
|00000f50| 01 00 00 00 72 73 01 00 | 00 00 52 73 01 00 00 00 |....rs..|..Rs....|
|00000f60| 75 73 01 00 00 00 55 73 | 02 00 00 00 72 27 73 02 |us....Us|....r's.|
|00000f70| 00 00 00 72 22 73 02 00 | 00 00 52 27 73 02 00 00 |...r"s..|..R's...|
|00000f80| 00 52 22 73 02 00 00 00 | 75 27 73 02 00 00 00 75 |.R"s....|u's....u|
|00000f90| 22 73 02 00 00 00 55 27 | 73 02 00 00 00 55 22 73 |"s....U'|s....U"s|
|00000fa0| 03 00 00 00 75 72 27 73 | 03 00 00 00 75 72 22 73 |....ur's|....ur"s|
|00000fb0| 03 00 00 00 55 72 27 73 | 03 00 00 00 55 72 22 73 |....Ur's|....Ur"s|
|00000fc0| 03 00 00 00 75 52 27 73 | 03 00 00 00 75 52 22 73 |....uR's|....uR"s|
|00000fd0| 03 00 00 00 55 52 27 73 | 03 00 00 00 55 52 22 69 |....UR's|....UR"i|
|00000fe0| 08 00 00 00 73 0a 00 00 | 00 54 6f 6b 65 6e 45 72 |....s...|.TokenEr|
|00000ff0| 72 6f 72 63 00 00 00 00 | 00 00 00 00 01 00 00 00 |rorc....|........|
|00001000| 42 00 00 00 73 08 00 00 | 00 74 00 00 5a 01 00 52 |B...s...|.t..Z..R|
|00001010| 53 28 01 00 00 00 4e 28 | 02 00 00 00 73 08 00 00 |S(....N(|....s...|
|00001020| 00 5f 5f 6e 61 6d 65 5f | 5f 73 0a 00 00 00 5f 5f |.__name_|_s....__|
|00001030| 6d 6f 64 75 6c 65 5f 5f | 28 00 00 00 00 28 00 00 |module__|(....(..|
|00001040| 00 00 28 00 00 00 00 73 | 4b 00 00 00 2f 4c 69 62 |..(....s|K.../Lib|
|00001050| 72 61 72 79 2f 46 72 61 | 6d 65 77 6f 72 6b 73 2f |rary/Fra|meworks/|
|00001060| 50 79 74 68 6f 6e 2e 66 | 72 61 6d 65 77 6f 72 6b |Python.f|ramework|
|00001070| 2f 56 65 72 73 69 6f 6e | 73 2f 32 2e 33 2f 6c 69 |/Version|s/2.3/li|
|00001080| 62 2f 70 79 74 68 6f 6e | 32 2e 33 2f 74 6f 6b 65 |b/python|2.3/toke|
|00001090| 6e 69 7a 65 2e 70 79 73 | 0a 00 00 00 54 6f 6b 65 |nize.pys|....Toke|
|000010a0| 6e 45 72 72 6f 72 83 00 | 00 00 73 02 00 00 00 06 |nError..|..s.....|
|000010b0| 00 73 0e 00 00 00 53 74 | 6f 70 54 6f 6b 65 6e 69 |.s....St|opTokeni|
|000010c0| 7a 69 6e 67 63 00 00 00 | 00 00 00 00 00 01 00 00 |zingc...|........|
|000010d0| 00 42 00 00 00 73 08 00 | 00 00 74 00 00 5a 01 00 |.B...s..|..t..Z..|
|000010e0| 52 53 28 01 00 00 00 4e | 28 02 00 00 00 73 08 00 |RS(....N|(....s..|
|000010f0| 00 00 5f 5f 6e 61 6d 65 | 5f 5f 73 0a 00 00 00 5f |..__name|__s...._|
|00001100| 5f 6d 6f 64 75 6c 65 5f | 5f 28 00 00 00 00 28 00 |_module_|_(....(.|
|00001110| 00 00 00 28 00 00 00 00 | 73 4b 00 00 00 2f 4c 69 |...(....|sK.../Li|
|00001120| 62 72 61 72 79 2f 46 72 | 61 6d 65 77 6f 72 6b 73 |brary/Fr|ameworks|
|00001130| 2f 50 79 74 68 6f 6e 2e | 66 72 61 6d 65 77 6f 72 |/Python.|framewor|
|00001140| 6b 2f 56 65 72 73 69 6f | 6e 73 2f 32 2e 33 2f 6c |k/Versio|ns/2.3/l|
|00001150| 69 62 2f 70 79 74 68 6f | 6e 32 2e 33 2f 74 6f 6b |ib/pytho|n2.3/tok|
|00001160| 65 6e 69 7a 65 2e 70 79 | 73 0e 00 00 00 53 74 6f |enize.py|s....Sto|
|00001170| 70 54 6f 6b 65 6e 69 7a | 69 6e 67 85 00 00 00 73 |pTokeniz|ing....s|
|00001180| 02 00 00 00 06 00 63 05 | 00 00 00 09 00 00 00 08 |......c.|........|
|00001190| 00 00 00 43 00 00 00 73 | 41 00 00 00 7c 02 00 5c |...C...s|A...|..\|
|000011a0| 02 00 7d 05 00 7d 06 00 | 7c 03 00 5c 02 00 7d 07 |..}..}..||..\..}.|
|000011b0| 00 7d 08 00 64 01 00 7c | 05 00 7c 06 00 7c 07 00 |.}..d..||..|..|..|
|000011c0| 7c 08 00 74 04 00 7c 00 | 00 19 74 06 00 7c 01 00 ||..t..|.|..t..|..|
|000011d0| 83 01 00 66 06 00 16 47 | 48 64 00 00 53 28 02 00 |...f...G|Hd..S(..|
|000011e0| 00 00 4e 73 12 00 00 00 | 25 64 2c 25 64 2d 25 64 |..Ns....|%d,%d-%d|
|000011f0| 2c 25 64 3a 09 25 73 09 | 25 73 28 08 00 00 00 73 |,%d:.%s.|%s(....s|
|00001200| 04 00 00 00 73 72 6f 77 | 73 04 00 00 00 73 63 6f |....srow|s....sco|
|00001210| 6c 73 04 00 00 00 65 72 | 6f 77 73 04 00 00 00 65 |ls....er|ows....e|
|00001220| 63 6f 6c 73 08 00 00 00 | 74 6f 6b 5f 6e 61 6d 65 |cols....|tok_name|
|00001230| 73 04 00 00 00 74 79 70 | 65 73 04 00 00 00 72 65 |s....typ|es....re|
|00001240| 70 72 73 05 00 00 00 74 | 6f 6b 65 6e 28 09 00 00 |prs....t|oken(...|
|00001250| 00 73 04 00 00 00 74 79 | 70 65 73 05 00 00 00 74 |.s....ty|pes....t|
|00001260| 6f 6b 65 6e 73 02 00 00 | 00 2e 34 73 02 00 00 00 |okens...|..4s....|
|00001270| 2e 36 73 04 00 00 00 6c | 69 6e 65 73 04 00 00 00 |.6s....l|ines....|
|00001280| 73 72 6f 77 73 04 00 00 | 00 73 63 6f 6c 73 04 00 |srows...|.scols..|
|00001290| 00 00 65 72 6f 77 73 04 | 00 00 00 65 63 6f 6c 28 |..erows.|...ecol(|
|000012a0| 00 00 00 00 28 00 00 00 | 00 73 4b 00 00 00 2f 4c |....(...|.sK.../L|
|000012b0| 69 62 72 61 72 79 2f 46 | 72 61 6d 65 77 6f 72 6b |ibrary/F|ramework|
|000012c0| 73 2f 50 79 74 68 6f 6e | 2e 66 72 61 6d 65 77 6f |s/Python|.framewo|
|000012d0| 72 6b 2f 56 65 72 73 69 | 6f 6e 73 2f 32 2e 33 2f |rk/Versi|ons/2.3/|
|000012e0| 6c 69 62 2f 70 79 74 68 | 6f 6e 32 2e 33 2f 74 6f |lib/pyth|on2.3/to|
|000012f0| 6b 65 6e 69 7a 65 2e 70 | 79 73 0a 00 00 00 70 72 |kenize.p|ys....pr|
|00001300| 69 6e 74 74 6f 6b 65 6e | 87 00 00 00 73 02 00 00 |inttoken|....s...|
|00001310| 00 18 01 63 02 00 00 00 | 02 00 00 00 05 00 00 00 |...c....|........|
|00001320| 43 00 00 00 73 2b 00 00 | 00 79 11 00 74 00 00 7c |C...s+..|.y..t..||
|00001330| 00 00 7c 01 00 83 02 00 | 01 57 6e 13 00 04 74 03 |..|.....|.Wn...t.|
|00001340| 00 6a 0a 00 6f 07 00 01 | 01 01 01 6e 02 00 01 58 |.j..o...|...n...X|
|00001350| 64 01 00 53 28 02 00 00 | 00 73 3a 02 00 00 0a 20 |d..S(...|.s:.... |
|00001360| 20 20 20 54 68 65 20 74 | 6f 6b 65 6e 69 7a 65 28 |   The t|okenize(|
|00001370| 29 20 66 75 6e 63 74 69 | 6f 6e 20 61 63 63 65 70 |) functi|on accep|
|00001380| 74 73 20 74 77 6f 20 70 | 61 72 61 6d 65 74 65 72 |ts two p|arameter|
|00001390| 73 3a 20 6f 6e 65 20 72 | 65 70 72 65 73 65 6e 74 |s: one r|epresent|
|000013a0| 69 6e 67 20 74 68 65 0a | 20 20 20 20 69 6e 70 75 |ing the.|    inpu|
|000013b0| 74 20 73 74 72 65 61 6d | 2c 20 61 6e 64 20 6f 6e |t stream|, and on|
|000013c0| 65 20 70 72 6f 76 69 64 | 69 6e 67 20 61 6e 20 6f |e provid|ing an o|
|000013d0| 75 74 70 75 74 20 6d 65 | 63 68 61 6e 69 73 6d 20 |utput me|chanism |
|000013e0| 66 6f 72 20 74 6f 6b 65 | 6e 69 7a 65 28 29 2e 0a |for toke|nize()..|
|000013f0| 0a 20 20 20 20 54 68 65 | 20 66 69 72 73 74 20 70 |.    The| first p|
|00001400| 61 72 61 6d 65 74 65 72 | 2c 20 72 65 61 64 6c 69 |arameter|, readli|
|00001410| 6e 65 2c 20 6d 75 73 74 | 20 62 65 20 61 20 63 61 |ne, must| be a ca|
|00001420| 6c 6c 61 62 6c 65 20 6f | 62 6a 65 63 74 20 77 68 |llable o|bject wh|
|00001430| 69 63 68 20 70 72 6f 76 | 69 64 65 73 0a 20 20 20 |ich prov|ides.   |
|00001440| 20 74 68 65 20 73 61 6d | 65 20 69 6e 74 65 72 66 | the sam|e interf|
|00001450| 61 63 65 20 61 73 20 74 | 68 65 20 72 65 61 64 6c |ace as t|he readl|
|00001460| 69 6e 65 28 29 20 6d 65 | 74 68 6f 64 20 6f 66 20 |ine() me|thod of |
|00001470| 62 75 69 6c 74 2d 69 6e | 20 66 69 6c 65 20 6f 62 |built-in| file ob|
|00001480| 6a 65 63 74 73 2e 0a 20 | 20 20 20 45 61 63 68 20 |jects.. |   Each |
|00001490| 63 61 6c 6c 20 74 6f 20 | 74 68 65 20 66 75 6e 63 |call to |the func|
|000014a0| 74 69 6f 6e 20 73 68 6f | 75 6c 64 20 72 65 74 75 |tion sho|uld retu|
|000014b0| 72 6e 20 6f 6e 65 20 6c | 69 6e 65 20 6f 66 20 69 |rn one l|ine of i|
|000014c0| 6e 70 75 74 20 61 73 20 | 61 20 73 74 72 69 6e 67 |nput as |a string|
|000014d0| 2e 0a 0a 20 20 20 20 54 | 68 65 20 73 65 63 6f 6e |...    T|he secon|
|000014e0| 64 20 70 61 72 61 6d 65 | 74 65 72 2c 20 74 6f 6b |d parame|ter, tok|
|000014f0| 65 6e 65 61 74 65 72 2c | 20 6d 75 73 74 20 61 6c |eneater,| must al|
|00001500| 73 6f 20 62 65 20 61 20 | 63 61 6c 6c 61 62 6c 65 |so be a |callable|
|00001510| 20 6f 62 6a 65 63 74 2e | 20 49 74 20 69 73 0a 20 | object.| It is. |
|00001520| 20 20 20 63 61 6c 6c 65 | 64 20 6f 6e 63 65 20 66 |   calle|d once f|
|00001530| 6f 72 20 65 61 63 68 20 | 74 6f 6b 65 6e 2c 20 77 |or each |token, w|
|00001540| 69 74 68 20 66 69 76 65 | 20 61 72 67 75 6d 65 6e |ith five| argumen|
|00001550| 74 73 2c 20 63 6f 72 72 | 65 73 70 6f 6e 64 69 6e |ts, corr|espondin|
|00001560| 67 20 74 6f 20 74 68 65 | 0a 20 20 20 20 74 75 70 |g to the|.    tup|
|00001570| 6c 65 73 20 67 65 6e 65 | 72 61 74 65 64 20 62 79 |les gene|rated by|
|00001580| 20 67 65 6e 65 72 61 74 | 65 5f 74 6f 6b 65 6e 73 | generat|e_tokens|
|00001590| 28 29 2e 0a 20 20 20 20 | 4e 28 04 00 00 00 73 0d |()..    |N(....s.|
|000015a0| 00 00 00 74 6f 6b 65 6e | 69 7a 65 5f 6c 6f 6f 70 |...token|ize_loop|
|000015b0| 73 08 00 00 00 72 65 61 | 64 6c 69 6e 65 73 0a 00 |s....rea|dlines..|
|000015c0| 00 00 74 6f 6b 65 6e 65 | 61 74 65 72 73 0e 00 00 |..tokene|aters...|
|000015d0| 00 53 74 6f 70 54 6f 6b | 65 6e 69 7a 69 6e 67 28 |.StopTok|enizing(|
|000015e0| 02 00 00 00 73 08 00 00 | 00 72 65 61 64 6c 69 6e |....s...|.readlin|
|000015f0| 65 73 0a 00 00 00 74 6f | 6b 65 6e 65 61 74 65 72 |es....to|keneater|
|00001600| 28 00 00 00 00 28 00 00 | 00 00 73 4b 00 00 00 2f |(....(..|..sK.../|
|00001610| 4c 69 62 72 61 72 79 2f | 46 72 61 6d 65 77 6f 72 |Library/|Framewor|
|00001620| 6b 73 2f 50 79 74 68 6f | 6e 2e 66 72 61 6d 65 77 |ks/Pytho|n.framew|
|00001630| 6f 72 6b 2f 56 65 72 73 | 69 6f 6e 73 2f 32 2e 33 |ork/Vers|ions/2.3|
|00001640| 2f 6c 69 62 2f 70 79 74 | 68 6f 6e 32 2e 33 2f 74 |/lib/pyt|hon2.3/t|
|00001650| 6f 6b 65 6e 69 7a 65 2e | 70 79 73 08 00 00 00 74 |okenize.|pys....t|
|00001660| 6f 6b 65 6e 69 7a 65 8b | 00 00 00 73 0a 00 00 00 |okenize.|...s....|
|00001670| 00 0c 00 01 03 01 11 01 | 0e 01 63 02 00 00 00 03 |........|..c.....|
|00001680| 00 00 00 03 00 00 00 43 | 00 00 00 73 25 00 00 00 |.......C|...s%...|
|00001690| 78 1e 00 74 00 00 7c 00 | 00 83 01 00 44 5d 10 00 |x..t..|.|....D]..|
|000016a0| 7d 02 00 7c 01 00 7c 02 | 00 8c 00 00 01 71 0d 00 |}..|..|.|.....q..|
|000016b0| 57 64 00 00 53 28 01 00 | 00 00 4e 28 04 00 00 00 |Wd..S(..|..N(....|
|000016c0| 73 0f 00 00 00 67 65 6e | 65 72 61 74 65 5f 74 6f |s....gen|erate_to|
|000016d0| 6b 65 6e 73 73 08 00 00 | 00 72 65 61 64 6c 69 6e |kenss...|.readlin|
|000016e0| 65 73 0a 00 00 00 74 6f | 6b 65 6e 5f 69 6e 66 6f |es....to|ken_info|
|000016f0| 73 0a 00 00 00 74 6f 6b | 65 6e 65 61 74 65 72 28 |s....tok|eneater(|
|00001700| 03 00 00 00 73 08 00 00 | 00 72 65 61 64 6c 69 6e |....s...|.readlin|
|00001710| 65 73 0a 00 00 00 74 6f | 6b 65 6e 65 61 74 65 72 |es....to|keneater|
|00001720| 73 0a 00 00 00 74 6f 6b | 65 6e 5f 69 6e 66 6f 28 |s....tok|en_info(|
|00001730| 00 00 00 00 28 00 00 00 | 00 73 4b 00 00 00 2f 4c |....(...|.sK.../L|
|00001740| 69 62 72 61 72 79 2f 46 | 72 61 6d 65 77 6f 72 6b |ibrary/F|ramework|
|00001750| 73 2f 50 79 74 68 6f 6e | 2e 66 72 61 6d 65 77 6f |s/Python|.framewo|
|00001760| 72 6b 2f 56 65 72 73 69 | 6f 6e 73 2f 32 2e 33 2f |rk/Versi|ons/2.3/|
|00001770| 6c 69 62 2f 70 79 74 68 | 6f 6e 32 2e 33 2f 74 6f |lib/pyth|on2.3/to|
|00001780| 6b 65 6e 69 7a 65 2e 70 | 79 73 0d 00 00 00 74 6f |kenize.p|ys....to|
|00001790| 6b 65 6e 69 7a 65 5f 6c | 6f 6f 70 9e 00 00 00 73 |kenize_l|oop....s|
|000017a0| 06 00 00 00 00 01 0d 00 | 06 01 63 01 00 00 00 19 |........|..c.....|
|000017b0| 00 00 00 06 00 00 00 63 | 00 00 00 73 ae 06 00 00 |.......c|...s....|
|000017c0| 64 01 00 04 7d 01 00 04 | 7d 18 00 7d 12 00 74 03 |d...}...|}..}..t.|
|000017d0| 00 69 04 00 64 02 00 17 | 64 03 00 66 02 00 5c 02 |.i..d...|d..f..\.|
|000017e0| 00 7d 03 00 7d 17 00 64 | 04 00 64 01 00 66 02 00 |.}..}..d|..d..f..|
|000017f0| 5c 02 00 7d 16 00 7d 0a | 00 74 09 00 7d 11 00 64 |\..}..}.|.t..}..d|
|00001800| 01 00 67 01 00 7d 10 00 | 78 0c 06 6e 04 00 6f 04 |..g..}..|x..n..o.|
|00001810| 06 01 7c 00 00 83 00 00 | 7d 05 00 7c 01 00 64 05 |..|.....|}..|..d.|
|00001820| 00 17 7d 01 00 64 01 00 | 74 0e 00 7c 05 00 83 01 |..}..d..|t..|....|
|00001830| 00 66 02 00 5c 02 00 7d | 02 00 7d 0d 00 7c 16 00 |.f..\..}|..}..|..|
|00001840| 6f ff 00 01 7c 05 00 0c | 6f 13 00 01 74 11 00 64 |o...|...|o...t..d|
|00001850| 06 00 7c 0c 00 66 02 00 | 82 02 00 6e 01 00 01 7c |..|..f..|...n...||
|00001860| 14 00 69 14 00 7c 05 00 | 83 01 00 7d 0e 00 7c 0e |..i..|..|...}..|.|
|00001870| 00 6f 54 00 01 7c 0e 00 | 69 16 00 64 01 00 83 01 |.oT..|..|i..d....|
|00001880| 00 04 7d 02 00 7d 07 00 | 74 17 00 7c 16 00 7c 05 |..}..}..|t..|..|.|
|00001890| 00 7c 07 00 20 17 7c 0c | 00 7c 01 00 7c 07 00 66 |.|.. .|.|.|..|..f|
|000018a0| 02 00 7c 11 00 7c 05 00 | 17 66 05 00 56 64 04 00 |..|..|..|.f..Vd..|
|000018b0| 64 01 00 66 02 00 5c 02 | 00 7d 16 00 7d 0a 00 74 |d..f..\.|.}..}..t|
|000018c0| 09 00 7d 11 00 71 45 03 | 01 7c 0a 00 6f 1f 00 01 |..}..qE.|.|..o...|
|000018d0| 7c 05 00 64 07 00 1f 64 | 08 00 6a 03 00 6f 0e 00 ||..d...d|..j..o..|
|000018e0| 01 7c 05 00 64 09 00 1f | 64 0a 00 6a 03 00 6f 36 |.|..d...|d..j..o6|
|000018f0| 00 01 74 18 00 7c 16 00 | 7c 05 00 17 7c 0c 00 7c |..t..|..||...|..||
|00001900| 01 00 74 0e 00 7c 05 00 | 83 01 00 66 02 00 7c 11 |..t..|..|...f..|.|
|00001910| 00 66 05 00 56 64 04 00 | 7d 16 00 74 09 00 7d 11 |.f..Vd..|}..t..}.|
|00001920| 00 71 52 00 71 45 03 01 | 7c 16 00 7c 05 00 17 7d |.qR.qE..||..|...}|
|00001930| 16 00 7c 11 00 7c 05 00 | 17 7d 11 00 71 52 00 6e |..|..|..|.}..qR.n|
|00001940| c3 01 01 7c 18 00 64 01 | 00 6a 02 00 6f 05 00 01 |...|..d.|.j..o...|
|00001950| 7c 12 00 0c 6f 86 01 01 | 7c 05 00 0c 6f 05 00 01 ||...o...||...o...|
|00001960| 50 6e 01 00 01 64 01 00 | 7d 15 00 78 7e 00 7c 02 |Pn...d..|}..x~.|.|
|00001970| 00 7c 0d 00 6a 00 00 6f | 70 00 01 7c 05 00 7c 02 |.|..j..o|p..|..|.|
|00001980| 00 19 64 0b 00 6a 02 00 | 6f 0e 00 01 7c 15 00 64 |..d..j..|o...|..d|
|00001990| 05 00 17 7d 15 00 6e 44 | 00 01 7c 05 00 7c 02 00 |...}..nD|..|..|..|
|000019a0| 19 64 0c 00 6a 02 00 6f | 16 00 01 7c 15 00 74 1a |.d..j..o|...|..t.|
|000019b0| 00 15 64 05 00 17 74 1a | 00 14 7d 15 00 6e 1d 00 |..d...t.|..}..n..|
|000019c0| 01 7c 05 00 7c 02 00 19 | 64 0d 00 6a 02 00 6f 0a |.|..|...|d..j..o.|
|000019d0| 00 01 64 01 00 7d 15 00 | 6e 02 00 01 50 7c 02 00 |..d..}..|n...P|..|
|000019e0| 64 05 00 17 7d 02 00 71 | ae 01 01 57 7c 02 00 7c |d...}..q|...W|..||
|000019f0| 0d 00 6a 02 00 6f 05 00 | 01 50 6e 01 00 01 7c 05 |..j..o..|.Pn...|.|
|00001a00| 00 7c 02 00 19 64 0e 00 | 6a 06 00 6f 44 00 01 74 |.|...d..|j..oD..t|
|00001a10| 1b 00 74 1c 00 66 02 00 | 7c 05 00 7c 02 00 19 64 |..t..f..||..|...d|
|00001a20| 0f 00 6a 02 00 19 7c 05 | 00 7c 02 00 1f 7c 01 00 |..j...|.|.|...|..|
|00001a30| 7c 02 00 66 02 00 7c 01 | 00 74 0e 00 7c 05 00 83 ||..f..|.|.t..|...|
|00001a40| 01 00 66 02 00 7c 05 00 | 66 05 00 56 71 52 00 6e |..f..|..|f..VqR.n|
|00001a50| 01 00 01 7c 15 00 7c 10 | 00 64 10 00 19 6a 04 00 |...|..|.|.d...j..|
|00001a60| 6f 34 00 01 7c 10 00 69 | 1d 00 7c 15 00 83 01 00 |o4..|..i|..|.....|
|00001a70| 01 74 1e 00 7c 05 00 7c | 02 00 20 7c 01 00 64 01 |.t..|..||.. |..d.|
|00001a80| 00 66 02 00 7c 01 00 7c | 02 00 66 02 00 7c 05 00 |.f..|..||..f..|..|
|00001a90| 66 05 00 56 6e 01 00 01 | 78 6a 00 7c 15 00 7c 10 |f..Vn...|xj.|..|.|
|00001aa0| 00 64 10 00 19 6a 00 00 | 6f 2d 00 01 7c 10 00 64 |.d...j..|o-..|..d|
|00001ab0| 10 00 20 7d 10 00 74 1f | 00 64 04 00 7c 01 00 7c |.. }..t.|.d..|..||
|00001ac0| 02 00 66 02 00 7c 01 00 | 7c 02 00 66 02 00 7c 05 |..f..|..||..f..|.|
|00001ad0| 00 66 05 00 56 71 db 02 | 01 57 6e 28 00 01 7c 05 |.f..Vq..|.Wn(..|.|
|00001ae0| 00 0c 6f 19 00 01 74 11 | 00 64 11 00 7c 01 00 64 |..o...t.|.d..|..d|
|00001af0| 01 00 66 02 00 66 02 00 | 82 02 00 6e 01 00 01 64 |..f..f..|...n...d|
|00001b00| 01 00 7d 12 00 78 0a 03 | 7c 02 00 7c 0d 00 6a 00 |..}..x..||..|..j.|
|00001b10| 00 6f fc 02 01 74 20 00 | 69 14 00 7c 05 00 7c 02 |.o...t .|i..|..|.|
|00001b20| 00 83 02 00 7d 13 00 7c | 13 00 6f ae 02 01 7c 13 |....}..||..o...|.|
|00001b30| 00 69 22 00 64 05 00 83 | 01 00 5c 02 00 7d 08 00 |.i".d...|..\..}..|
|00001b40| 7d 07 00 7c 01 00 7c 08 | 00 66 02 00 7c 01 00 7c |}..|..|.|.f..|..||
|00001b50| 07 00 66 02 00 7c 07 00 | 66 03 00 5c 03 00 7d 0f |..f..|..|f..\..}.|
|00001b60| 00 7d 06 00 7d 02 00 7c | 05 00 7c 08 00 7c 07 00 |.}..}..||..|..|..|
|00001b70| 21 7c 05 00 7c 08 00 19 | 66 02 00 5c 02 00 7d 0b |!|..|...|f..\..}.|
|00001b80| 00 7d 09 00 7c 09 00 7c | 17 00 6a 06 00 70 17 00 |.}..|..||..j..p..|
|00001b90| 01 7c 09 00 64 12 00 6a | 02 00 6f 0a 00 01 7c 0b |.|..d..j|..o...|.|
|00001ba0| 00 64 12 00 6a 03 00 6f | 17 00 01 74 28 00 7c 0b |.d..j..o|...t(.|.|
|00001bb0| 00 7c 0f 00 7c 06 00 7c | 05 00 66 05 00 56 71 4d |.|..|..||..f..VqM|
|00001bc0| 06 01 7c 09 00 64 13 00 | 6a 06 00 6f 2b 00 01 7c |..|..d..|j..o+..||
|00001bd0| 18 00 64 01 00 6a 04 00 | 6f 04 00 01 74 1b 00 70 |..d..j..|o...t..p|
|00001be0| 04 00 01 74 29 00 7c 0b | 00 7c 0f 00 7c 06 00 7c |...t).|.|.|..|..||
|00001bf0| 05 00 66 05 00 56 71 4d | 06 01 7c 09 00 64 0f 00 |..f..VqM|..|..d..|
|00001c00| 6a 02 00 6f 17 00 01 74 | 1c 00 7c 0b 00 7c 0f 00 |j..o...t|..|..|..|
|00001c10| 7c 06 00 7c 05 00 66 05 | 00 56 71 4d 06 01 7c 0b ||..|..f.|.VqM..|.|
|00001c20| 00 74 2a 00 6a 06 00 6f | 7d 00 01 74 2b 00 7c 0b |.t*.j..o|}..t+.|.|
|00001c30| 00 19 7d 14 00 7c 14 00 | 69 14 00 7c 05 00 7c 02 |..}..|..|i..|..|.|
|00001c40| 00 83 02 00 7d 0e 00 7c | 0e 00 6f 39 00 01 7c 0e |....}..||..o9..|.|
|00001c50| 00 69 16 00 64 01 00 83 | 01 00 7d 02 00 7c 05 00 |.i..d...|..}..|..|
|00001c60| 7c 08 00 7c 02 00 21 7d | 0b 00 74 17 00 7c 0b 00 ||..|..!}|..t..|..|
|00001c70| 7c 0f 00 7c 01 00 7c 02 | 00 66 02 00 7c 05 00 66 ||..|..|.|.f..|..f|
|00001c80| 05 00 56 71 18 06 01 7c | 01 00 7c 08 00 66 02 00 |..Vq...||..|..f..|
|00001c90| 7d 0c 00 7c 05 00 7c 08 | 00 1f 7d 16 00 7c 05 00 |}..|..|.|..}..|..|
|00001ca0| 7d 11 00 50 71 4d 06 01 | 7c 09 00 74 2c 00 6a 06 |}..PqM..||..t,.j.|
|00001cb0| 00 70 1f 00 01 7c 0b 00 | 64 14 00 20 74 2c 00 6a |.p...|..|d.. t,.j|
|00001cc0| 06 00 70 0e 00 01 7c 0b | 00 64 15 00 20 74 2c 00 |..p...|.|.d.. t,.|
|00001cd0| 6a 06 00 6f 7d 00 01 7c | 0b 00 64 10 00 19 64 16 |j..o}..||..d...d.|
|00001ce0| 00 6a 02 00 6f 55 00 01 | 7c 01 00 7c 08 00 66 02 |.j..oU..||..|..f.|
|00001cf0| 00 7d 0c 00 74 2b 00 7c | 09 00 19 70 1b 00 01 74 |.}..t+.||...p...t|
|00001d00| 2b 00 7c 0b 00 64 05 00 | 19 19 70 0c 00 01 74 2b |+.|..d..|..p...t+|
|00001d10| 00 7c 0b 00 64 14 00 19 | 19 7d 14 00 7c 05 00 7c |.|..d...|.}..|..||
|00001d20| 08 00 1f 64 05 00 66 02 | 00 5c 02 00 7d 16 00 7d |...d..f.|.\..}..}|
|00001d30| 0a 00 7c 05 00 7d 11 00 | 50 71 18 06 01 74 17 00 |..|..}..|Pq...t..|
|00001d40| 7c 0b 00 7c 0f 00 7c 06 | 00 7c 05 00 66 05 00 56 ||..|..|.|.|..f..V|
|00001d50| 71 4d 06 01 7c 09 00 7c | 03 00 6a 06 00 6f 17 00 |qM..|..||..j..o..|
|00001d60| 01 74 2d 00 7c 0b 00 7c | 0f 00 7c 06 00 7c 05 00 |.t-.|..||..|..|..|
|00001d70| 66 05 00 56 71 4d 06 01 | 7c 09 00 64 17 00 6a 02 |f..VqM..||..d..j.|
|00001d80| 00 6f 0a 00 01 64 05 00 | 7d 12 00 71 4d 06 01 7c |.o...d..|}..qM..||
|00001d90| 09 00 64 18 00 6a 06 00 | 6f 0e 00 01 7c 18 00 64 |..d..j..|o...|..d|
|00001da0| 05 00 17 7d 18 00 6e 1c | 00 01 7c 09 00 64 19 00 |...}..n.|..|..d..|
|00001db0| 6a 06 00 6f 0e 00 01 7c | 18 00 64 05 00 18 7d 18 |j..o...||..d...}.|
|00001dc0| 00 6e 01 00 01 74 2e 00 | 7c 0b 00 7c 0f 00 7c 06 |.n...t..||..|..|.|
|00001dd0| 00 7c 05 00 66 05 00 56 | 71 48 03 01 74 18 00 7c |.|..f..V|qH..t..||
|00001de0| 05 00 7c 02 00 19 7c 01 | 00 7c 02 00 66 02 00 7c |..|...|.|.|..f..||
|00001df0| 01 00 7c 02 00 64 05 00 | 17 66 02 00 7c 05 00 66 |..|..d..|.f..|..f|
|00001e00| 05 00 56 7c 02 00 64 05 | 00 17 7d 02 00 71 48 03 |..V|..d.|..}..qH.|
|00001e10| 01 57 71 52 00 01 57 78 | 31 00 7c 10 00 64 05 00 |.WqR..Wx|1.|..d..|
|00001e20| 1f 44 5d 25 00 7d 04 00 | 74 1f 00 64 04 00 7c 01 |.D]%.}..|t..d..|.|
|00001e30| 00 64 01 00 66 02 00 7c | 01 00 64 01 00 66 02 00 |.d..f..||..d..f..|
|00001e40| 64 04 00 66 05 00 56 71 | 62 06 57 74 30 00 64 04 |d..f..Vq|b.Wt0.d.|
|00001e50| 00 7c 01 00 64 01 00 66 | 02 00 7c 01 00 64 01 00 |.|..d..f|..|..d..|
|00001e60| 66 02 00 64 04 00 66 05 | 00 56 64 1a 00 53 28 1b |f..d..f.|.Vd..S(.|
|00001e70| 00 00 00 73 b5 02 00 00 | 0a 20 20 20 20 54 68 65 |...s....|.    The|
|00001e80| 20 67 65 6e 65 72 61 74 | 65 5f 74 6f 6b 65 6e 73 | generat|e_tokens|
|00001e90| 28 29 20 67 65 6e 65 72 | 61 74 6f 72 20 72 65 71 |() gener|ator req|
|00001ea0| 75 69 72 65 73 20 6f 6e | 65 20 61 72 67 6d 65 6e |uires on|e argmen|
|00001eb0| 74 2c 20 72 65 61 64 6c | 69 6e 65 2c 20 77 68 69 |t, readl|ine, whi|
|00001ec0| 63 68 0a 20 20 20 20 6d | 75 73 74 20 62 65 20 61 |ch.    m|ust be a|
|00001ed0| 20 63 61 6c 6c 61 62 6c | 65 20 6f 62 6a 65 63 74 | callabl|e object|
|00001ee0| 20 77 68 69 63 68 20 70 | 72 6f 76 69 64 65 73 20 | which p|rovides |
|00001ef0| 74 68 65 20 73 61 6d 65 | 20 69 6e 74 65 72 66 61 |the same| interfa|
|00001f00| 63 65 20 61 73 20 74 68 | 65 0a 20 20 20 20 72 65 |ce as th|e.    re|
|00001f10| 61 64 6c 69 6e 65 28 29 | 20 6d 65 74 68 6f 64 20 |adline()| method |
|00001f20| 6f 66 20 62 75 69 6c 74 | 2d 69 6e 20 66 69 6c 65 |of built|-in file|
|00001f30| 20 6f 62 6a 65 63 74 73 | 2e 20 45 61 63 68 20 63 | objects|. Each c|
|00001f40| 61 6c 6c 20 74 6f 20 74 | 68 65 20 66 75 6e 63 74 |all to t|he funct|
|00001f50| 69 6f 6e 0a 20 20 20 20 | 73 68 6f 75 6c 64 20 72 |ion.    |should r|
|00001f60| 65 74 75 72 6e 20 6f 6e | 65 20 6c 69 6e 65 20 6f |eturn on|e line o|
|00001f70| 66 20 69 6e 70 75 74 20 | 61 73 20 61 20 73 74 72 |f input |as a str|
|00001f80| 69 6e 67 2e 0a 0a 20 20 | 20 20 54 68 65 20 67 65 |ing...  |  The ge|
|00001f90| 6e 65 72 61 74 6f 72 20 | 70 72 6f 64 75 63 65 73 |nerator |produces|
|00001fa0| 20 35 2d 74 75 70 6c 65 | 73 20 77 69 74 68 20 74 | 5-tuple|s with t|
|00001fb0| 68 65 73 65 20 6d 65 6d | 62 65 72 73 3a 20 74 68 |hese mem|bers: th|
|00001fc0| 65 20 74 6f 6b 65 6e 20 | 74 79 70 65 3b 20 74 68 |e token |type; th|
|00001fd0| 65 0a 20 20 20 20 74 6f | 6b 65 6e 20 73 74 72 69 |e.    to|ken stri|
|00001fe0| 6e 67 3b 20 61 20 32 2d | 74 75 70 6c 65 20 28 73 |ng; a 2-|tuple (s|
|00001ff0| 72 6f 77 2c 20 73 63 6f | 6c 29 20 6f 66 20 69 6e |row, sco|l) of in|
|00002000| 74 73 20 73 70 65 63 69 | 66 79 69 6e 67 20 74 68 |ts speci|fying th|
|00002010| 65 20 72 6f 77 20 61 6e | 64 0a 20 20 20 20 63 6f |e row an|d.    co|
|00002020| 6c 75 6d 6e 20 77 68 65 | 72 65 20 74 68 65 20 74 |lumn whe|re the t|
|00002030| 6f 6b 65 6e 20 62 65 67 | 69 6e 73 20 69 6e 20 74 |oken beg|ins in t|
|00002040| 68 65 20 73 6f 75 72 63 | 65 3b 20 61 20 32 2d 74 |he sourc|e; a 2-t|
|00002050| 75 70 6c 65 20 28 65 72 | 6f 77 2c 20 65 63 6f 6c |uple (er|ow, ecol|
|00002060| 29 20 6f 66 0a 20 20 20 | 20 69 6e 74 73 20 73 70 |) of.   | ints sp|
|00002070| 65 63 69 66 79 69 6e 67 | 20 74 68 65 20 72 6f 77 |ecifying| the row|
|00002080| 20 61 6e 64 20 63 6f 6c | 75 6d 6e 20 77 68 65 72 | and col|umn wher|
|00002090| 65 20 74 68 65 20 74 6f | 6b 65 6e 20 65 6e 64 73 |e the to|ken ends|
|000020a0| 20 69 6e 20 74 68 65 20 | 73 6f 75 72 63 65 3b 0a | in the |source;.|
|000020b0| 20 20 20 20 61 6e 64 20 | 74 68 65 20 6c 69 6e 65 |    and |the line|
|000020c0| 20 6f 6e 20 77 68 69 63 | 68 20 74 68 65 20 74 6f | on whic|h the to|
|000020d0| 6b 65 6e 20 77 61 73 20 | 66 6f 75 6e 64 2e 20 54 |ken was |found. T|
|000020e0| 68 65 20 6c 69 6e 65 20 | 70 61 73 73 65 64 20 69 |he line |passed i|
|000020f0| 73 20 74 68 65 0a 20 20 | 20 20 6c 6f 67 69 63 61 |s the.  |  logica|
|00002100| 6c 20 6c 69 6e 65 3b 20 | 63 6f 6e 74 69 6e 75 61 |l line; |continua|
|00002110| 74 69 6f 6e 20 6c 69 6e | 65 73 20 61 72 65 20 69 |tion lin|es are i|
|00002120| 6e 63 6c 75 64 65 64 2e | 0a 20 20 20 20 69 00 00 |ncluded.|.    i..|
|00002130| 00 00 73 01 00 00 00 5f | 73 0a 00 00 00 30 31 32 |..s...._|s....012|
|00002140| 33 34 35 36 37 38 39 73 | 00 00 00 00 69 01 00 00 |3456789s|....i...|
|00002150| 00 73 18 00 00 00 45 4f | 46 20 69 6e 20 6d 75 6c |.s....EO|F in mul|
|00002160| 74 69 2d 6c 69 6e 65 20 | 73 74 72 69 6e 67 69 fe |ti-line |stringi.|
|00002170| ff ff ff 73 02 00 00 00 | 5c 0a 69 fd ff ff ff 73 |...s....|\.i....s|
|00002180| 03 00 00 00 5c 0d 0a 73 | 01 00 00 00 20 73 01 00 |....\..s|.... s..|
|00002190| 00 00 09 73 01 00 00 00 | 0c 73 03 00 00 00 23 0d |...s....|.s....#.|
|000021a0| 0a 73 01 00 00 00 23 69 | ff ff ff ff 73 1b 00 00 |.s....#i|....s...|
|000021b0| 00 45 4f 46 20 69 6e 20 | 6d 75 6c 74 69 2d 6c 69 |.EOF in |multi-li|
|000021c0| 6e 65 20 73 74 61 74 65 | 6d 65 6e 74 73 01 00 00 |ne state|ments...|
|000021d0| 00 2e 73 02 00 00 00 0d | 0a 69 02 00 00 00 69 03 |..s.....|.i....i.|
|000021e0| 00 00 00 73 01 00 00 00 | 0a 73 01 00 00 00 5c 73 |...s....|.s....\s|
|000021f0| 03 00 00 00 28 5b 7b 73 | 03 00 00 00 29 5d 7d 4e |....([{s|....)]}N|
|00002200| 28 31 00 00 00 73 04 00 | 00 00 6c 6e 75 6d 73 08 |(1...s..|..lnums.|
|00002210| 00 00 00 70 61 72 65 6e | 6c 65 76 73 09 00 00 00 |...paren|levs....|
|00002220| 63 6f 6e 74 69 6e 75 65 | 64 73 06 00 00 00 73 74 |continue|ds....st|
|00002230| 72 69 6e 67 73 0d 00 00 | 00 61 73 63 69 69 5f 6c |rings...|.ascii_l|
|00002240| 65 74 74 65 72 73 73 09 | 00 00 00 6e 61 6d 65 63 |etterss.|...namec|
|00002250| 68 61 72 73 73 08 00 00 | 00 6e 75 6d 63 68 61 72 |harss...|.numchar|
|00002260| 73 73 07 00 00 00 63 6f | 6e 74 73 74 72 73 08 00 |ss....co|ntstrs..|
|00002270| 00 00 6e 65 65 64 63 6f | 6e 74 73 04 00 00 00 4e |..needco|nts....N|
|00002280| 6f 6e 65 73 08 00 00 00 | 63 6f 6e 74 6c 69 6e 65 |ones....|contline|
|00002290| 73 07 00 00 00 69 6e 64 | 65 6e 74 73 73 08 00 00 |s....ind|entss...|
|000022a0| 00 72 65 61 64 6c 69 6e | 65 73 04 00 00 00 6c 69 |.readlin|es....li|
|000022b0| 6e 65 73 03 00 00 00 6c | 65 6e 73 03 00 00 00 70 |nes....l|ens....p|
|000022c0| 6f 73 73 03 00 00 00 6d | 61 78 73 0a 00 00 00 54 |oss....m|axs....T|
|000022d0| 6f 6b 65 6e 45 72 72 6f | 72 73 08 00 00 00 73 74 |okenErro|rs....st|
|000022e0| 72 73 74 61 72 74 73 07 | 00 00 00 65 6e 64 70 72 |rstarts.|...endpr|
|000022f0| 6f 67 73 05 00 00 00 6d | 61 74 63 68 73 08 00 00 |ogs....m|atchs...|
|00002300| 00 65 6e 64 6d 61 74 63 | 68 73 03 00 00 00 65 6e |.endmatc|hs....en|
|00002310| 64 73 06 00 00 00 53 54 | 52 49 4e 47 73 0a 00 00 |ds....ST|RINGs...|
|00002320| 00 45 52 52 4f 52 54 4f | 4b 45 4e 73 06 00 00 00 |.ERRORTO|KENs....|
|00002330| 63 6f 6c 75 6d 6e 73 07 | 00 00 00 74 61 62 73 69 |columns.|...tabsi|
|00002340| 7a 65 73 02 00 00 00 4e | 4c 73 07 00 00 00 43 4f |zes....N|Ls....CO|
|00002350| 4d 4d 45 4e 54 73 06 00 | 00 00 61 70 70 65 6e 64 |MMENTs..|..append|
|00002360| 73 06 00 00 00 49 4e 44 | 45 4e 54 73 06 00 00 00 |s....IND|ENTs....|
|00002370| 44 45 44 45 4e 54 73 0a | 00 00 00 70 73 65 75 64 |DEDENTs.|...pseud|
|00002380| 6f 70 72 6f 67 73 0b 00 | 00 00 70 73 65 75 64 6f |oprogs..|..pseudo|
|00002390| 6d 61 74 63 68 73 04 00 | 00 00 73 70 61 6e 73 05 |matchs..|..spans.|
|000023a0| 00 00 00 73 74 61 72 74 | 73 04 00 00 00 73 70 6f |...start|s....spo|
|000023b0| 73 73 04 00 00 00 65 70 | 6f 73 73 05 00 00 00 74 |ss....ep|oss....t|
|000023c0| 6f 6b 65 6e 73 07 00 00 | 00 69 6e 69 74 69 61 6c |okens...|.initial|
|000023d0| 73 06 00 00 00 4e 55 4d | 42 45 52 73 07 00 00 00 |s....NUM|BERs....|
|000023e0| 4e 45 57 4c 49 4e 45 73 | 0d 00 00 00 74 72 69 70 |NEWLINEs|....trip|
|000023f0| 6c 65 5f 71 75 6f 74 65 | 64 73 08 00 00 00 65 6e |le_quote|ds....en|
|00002400| 64 70 72 6f 67 73 73 0d | 00 00 00 73 69 6e 67 6c |dprogss.|...singl|
|00002410| 65 5f 71 75 6f 74 65 64 | 73 04 00 00 00 4e 41 4d |e_quoted|s....NAM|
|00002420| 45 73 02 00 00 00 4f 50 | 73 06 00 00 00 69 6e 64 |Es....OP|s....ind|
|00002430| 65 6e 74 73 09 00 00 00 | 45 4e 44 4d 41 52 4b 45 |ents....|ENDMARKE|
|00002440| 52 28 19 00 00 00 73 08 | 00 00 00 72 65 61 64 6c |R(....s.|...readl|
|00002450| 69 6e 65 73 04 00 00 00 | 6c 6e 75 6d 73 03 00 00 |ines....|lnums...|
|00002460| 00 70 6f 73 73 09 00 00 | 00 6e 61 6d 65 63 68 61 |.poss...|.namecha|
|00002470| 72 73 73 06 00 00 00 69 | 6e 64 65 6e 74 73 04 00 |rss....i|ndents..|
|00002480| 00 00 6c 69 6e 65 73 04 | 00 00 00 65 70 6f 73 73 |..lines.|...eposs|
|00002490| 03 00 00 00 65 6e 64 73 | 05 00 00 00 73 74 61 72 |....ends|....star|
|000024a0| 74 73 07 00 00 00 69 6e | 69 74 69 61 6c 73 08 00 |ts....in|itials..|
|000024b0| 00 00 6e 65 65 64 63 6f | 6e 74 73 05 00 00 00 74 |..needco|nts....t|
|000024c0| 6f 6b 65 6e 73 08 00 00 | 00 73 74 72 73 74 61 72 |okens...|.strstar|
|000024d0| 74 73 03 00 00 00 6d 61 | 78 73 08 00 00 00 65 6e |ts....ma|xs....en|
|000024e0| 64 6d 61 74 63 68 73 04 | 00 00 00 73 70 6f 73 73 |dmatchs.|...sposs|
|000024f0| 07 00 00 00 69 6e 64 65 | 6e 74 73 73 08 00 00 00 |....inde|ntss....|
|00002500| 63 6f 6e 74 6c 69 6e 65 | 73 09 00 00 00 63 6f 6e |contline|s....con|
|00002510| 74 69 6e 75 65 64 73 0b | 00 00 00 70 73 65 75 64 |tinueds.|...pseud|
|00002520| 6f 6d 61 74 63 68 73 07 | 00 00 00 65 6e 64 70 72 |omatchs.|...endpr|
|00002530| 6f 67 73 06 00 00 00 63 | 6f 6c 75 6d 6e 73 07 00 |ogs....c|olumns..|
|00002540| 00 00 63 6f 6e 74 73 74 | 72 73 08 00 00 00 6e 75 |..contst|rs....nu|
|00002550| 6d 63 68 61 72 73 73 08 | 00 00 00 70 61 72 65 6e |mcharss.|...paren|
|00002560| 6c 65 76 28 00 00 00 00 | 28 00 00 00 00 73 4b 00 |lev(....|(....sK.|
|00002570| 00 00 2f 4c 69 62 72 61 | 72 79 2f 46 72 61 6d 65 |../Libra|ry/Frame|
|00002580| 77 6f 72 6b 73 2f 50 79 | 74 68 6f 6e 2e 66 72 61 |works/Py|thon.fra|
|00002590| 6d 65 77 6f 72 6b 2f 56 | 65 72 73 69 6f 6e 73 2f |mework/V|ersions/|
|000025a0| 32 2e 33 2f 6c 69 62 2f | 70 79 74 68 6f 6e 32 2e |2.3/lib/|python2.|
|000025b0| 33 2f 74 6f 6b 65 6e 69 | 7a 65 2e 70 79 73 0f 00 |3/tokeni|ze.pys..|
|000025c0| 00 00 67 65 6e 65 72 61 | 74 65 5f 74 6f 6b 65 6e |..genera|te_token|
|000025d0| 73 a2 00 00 00 73 d0 00 | 00 00 00 0d 00 01 0e 01 |s....s..|........|
|000025e0| 19 01 12 01 06 01 09 02 | 03 00 07 01 09 01 0a 01 |........|........|
|000025f0| 18 02 07 01 08 01 13 01 | 0f 01 07 01 13 01 25 02 |........|......%.|
|00002600| 12 01 0a 01 29 01 23 02 | 06 01 06 01 07 02 0a 01 |....).#.|........|
|00002610| 0a 01 07 02 15 01 08 00 | 05 01 06 01 03 00 0d 01 |........|........|
|00002620| 11 00 0e 01 11 00 16 01 | 11 00 0a 01 01 01 0f 01 |........|........|
|00002630| 0d 00 05 02 11 01 3d 02 | 07 02 11 01 0d 01 27 01 |......=.|......'.|
|00002640| 03 00 11 01 0a 01 28 03 | 08 01 19 01 06 02 03 00 |......(.|........|
|00002650| 0d 01 12 01 07 01 15 01 | 24 01 1d 02 27 02 17 01 |........|$...'...|
|00002660| 0d 01 2b 02 0d 01 17 01 | 0d 01 0a 01 12 01 07 01 |..+.....|........|
|00002670| 0f 01 0d 01 1d 02 0c 01 | 0a 01 06 01 05 01 2f 03 |........|....../.|
|00002680| 11 01 0c 01 28 02 16 01 | 06 01 05 02 17 01 0d 01 |....(...|........|
|00002690| 17 01 0d 01 0a 02 0d 00 | 0e 01 0d 00 0e 01 17 02 |........|........|
|000026a0| 27 02 14 02 0b 00 06 01 | 23 01 73 08 00 00 00 5f |'.......|#.s...._|
|000026b0| 5f 6d 61 69 6e 5f 5f 28 | 49 00 00 00 73 07 00 00 |_main__(|I...s...|
|000026c0| 00 5f 5f 64 6f 63 5f 5f | 73 0a 00 00 00 5f 5f 61 |.__doc__|s....__a|
|000026d0| 75 74 68 6f 72 5f 5f 73 | 0b 00 00 00 5f 5f 63 72 |uthor__s|....__cr|
|000026e0| 65 64 69 74 73 5f 5f 73 | 06 00 00 00 73 74 72 69 |edits__s|....stri|
|000026f0| 6e 67 73 02 00 00 00 72 | 65 73 05 00 00 00 74 6f |ngs....r|es....to|
|00002700| 6b 65 6e 73 06 00 00 00 | 61 70 70 65 6e 64 73 04 |kens....|appends.|
|00002710| 00 00 00 5f 5b 31 5d 73 | 03 00 00 00 64 69 72 73 |..._[1]s|....dirs|
|00002720| 01 00 00 00 78 73 07 00 | 00 00 5f 5f 61 6c 6c 5f |....xs..|..__all_|
|00002730| 5f 73 08 00 00 00 4e 5f | 54 4f 4b 45 4e 53 73 07 |_s....N_|TOKENSs.|
|00002740| 00 00 00 43 4f 4d 4d 45 | 4e 54 73 08 00 00 00 74 |...COMME|NTs....t|
|00002750| 6f 6b 5f 6e 61 6d 65 73 | 02 00 00 00 4e 4c 73 05 |ok_names|....NLs.|
|00002760| 00 00 00 67 72 6f 75 70 | 73 03 00 00 00 61 6e 79 |...group|s....any|
|00002770| 73 05 00 00 00 6d 61 79 | 62 65 73 0a 00 00 00 57 |s....may|bes....W|
|00002780| 68 69 74 65 73 70 61 63 | 65 73 07 00 00 00 43 6f |hitespac|es....Co|
|00002790| 6d 6d 65 6e 74 73 06 00 | 00 00 49 67 6e 6f 72 65 |mments..|..Ignore|
|000027a0| 73 04 00 00 00 4e 61 6d | 65 73 09 00 00 00 48 65 |s....Nam|es....He|
|000027b0| 78 6e 75 6d 62 65 72 73 | 09 00 00 00 4f 63 74 6e |xnumbers|....Octn|
|000027c0| 75 6d 62 65 72 73 09 00 | 00 00 44 65 63 6e 75 6d |umbers..|..Decnum|
|000027d0| 62 65 72 73 09 00 00 00 | 49 6e 74 6e 75 6d 62 65 |bers....|Intnumbe|
|000027e0| 72 73 08 00 00 00 45 78 | 70 6f 6e 65 6e 74 73 0a |rs....Ex|ponents.|
|000027f0| 00 00 00 50 6f 69 6e 74 | 66 6c 6f 61 74 73 08 00 |...Point|floats..|
|00002800| 00 00 45 78 70 66 6c 6f | 61 74 73 0b 00 00 00 46 |..Expflo|ats....F|
|00002810| 6c 6f 61 74 6e 75 6d 62 | 65 72 73 0a 00 00 00 49 |loatnumb|ers....I|
|00002820| 6d 61 67 6e 75 6d 62 65 | 72 73 06 00 00 00 4e 75 |magnumbe|rs....Nu|
|00002830| 6d 62 65 72 73 06 00 00 | 00 53 69 6e 67 6c 65 73 |mbers...|.Singles|
|00002840| 06 00 00 00 44 6f 75 62 | 6c 65 73 07 00 00 00 53 |....Doub|les....S|
|00002850| 69 6e 67 6c 65 33 73 07 | 00 00 00 44 6f 75 62 6c |ingle3s.|...Doubl|
|00002860| 65 33 73 06 00 00 00 54 | 72 69 70 6c 65 73 06 00 |e3s....T|riples..|
|00002870| 00 00 53 74 72 69 6e 67 | 73 08 00 00 00 4f 70 65 |..String|s....Ope|
|00002880| 72 61 74 6f 72 73 07 00 | 00 00 42 72 61 63 6b 65 |rators..|..Bracke|
|00002890| 74 73 07 00 00 00 53 70 | 65 63 69 61 6c 73 05 00 |ts....Sp|ecials..|
|000028a0| 00 00 46 75 6e 6e 79 73 | 0a 00 00 00 50 6c 61 69 |..Funnys|....Plai|
|000028b0| 6e 54 6f 6b 65 6e 73 05 | 00 00 00 54 6f 6b 65 6e |nTokens.|...Token|
|000028c0| 73 07 00 00 00 43 6f 6e | 74 53 74 72 73 0c 00 00 |s....Con|tStrs...|
|000028d0| 00 50 73 65 75 64 6f 45 | 78 74 72 61 73 73 0b 00 |.PseudoE|xtrass..|
|000028e0| 00 00 50 73 65 75 64 6f | 54 6f 6b 65 6e 73 03 00 |..Pseudo|Tokens..|
|000028f0| 00 00 6d 61 70 73 07 00 | 00 00 63 6f 6d 70 69 6c |..maps..|..compil|
|00002900| 65 73 09 00 00 00 74 6f | 6b 65 6e 70 72 6f 67 73 |es....to|kenprogs|
|00002910| 0a 00 00 00 70 73 65 75 | 64 6f 70 72 6f 67 73 0b |....pseu|doprogs.|
|00002920| 00 00 00 73 69 6e 67 6c | 65 33 70 72 6f 67 73 0b |...singl|e3progs.|
|00002930| 00 00 00 64 6f 75 62 6c | 65 33 70 72 6f 67 73 04 |...doubl|e3progs.|
|00002940| 00 00 00 4e 6f 6e 65 73 | 08 00 00 00 65 6e 64 70 |...Nones|....endp|
|00002950| 72 6f 67 73 73 0d 00 00 | 00 74 72 69 70 6c 65 5f |rogss...|.triple_|
|00002960| 71 75 6f 74 65 64 73 01 | 00 00 00 74 73 0d 00 00 |quoteds.|...ts...|
|00002970| 00 73 69 6e 67 6c 65 5f | 71 75 6f 74 65 64 73 07 |.single_|quoteds.|
|00002980| 00 00 00 74 61 62 73 69 | 7a 65 73 09 00 00 00 45 |...tabsi|zes....E|
|00002990| 78 63 65 70 74 69 6f 6e | 73 0a 00 00 00 54 6f 6b |xception|s....Tok|
|000029a0| 65 6e 45 72 72 6f 72 73 | 0e 00 00 00 53 74 6f 70 |enErrors|....Stop|
|000029b0| 54 6f 6b 65 6e 69 7a 69 | 6e 67 73 0a 00 00 00 70 |Tokenizi|ngs....p|
|000029c0| 72 69 6e 74 74 6f 6b 65 | 6e 73 08 00 00 00 74 6f |rinttoke|ns....to|
|000029d0| 6b 65 6e 69 7a 65 73 0d | 00 00 00 74 6f 6b 65 6e |kenizes.|...token|
|000029e0| 69 7a 65 5f 6c 6f 6f 70 | 73 0f 00 00 00 67 65 6e |ize_loop|s....gen|
|000029f0| 65 72 61 74 65 5f 74 6f | 6b 65 6e 73 73 08 00 00 |erate_to|kenss...|
|00002a00| 00 5f 5f 6e 61 6d 65 5f | 5f 73 03 00 00 00 73 79 |.__name_|_s....sy|
|00002a10| 73 73 03 00 00 00 6c 65 | 6e 73 04 00 00 00 61 72 |ss....le|ns....ar|
|00002a20| 67 76 73 04 00 00 00 6f | 70 65 6e 73 08 00 00 00 |gvs....o|pens....|
|00002a30| 72 65 61 64 6c 69 6e 65 | 73 05 00 00 00 73 74 64 |readline|s....std|
|00002a40| 69 6e 28 3b 00 00 00 73 | 05 00 00 00 46 75 6e 6e |in(;...s|....Funn|
|00002a50| 79 73 0b 00 00 00 50 73 | 65 75 64 6f 54 6f 6b 65 |ys....Ps|eudoToke|
|00002a60| 6e 73 0a 00 00 00 57 68 | 69 74 65 73 70 61 63 65 |ns....Wh|itespace|
|00002a70| 73 0b 00 00 00 46 6c 6f | 61 74 6e 75 6d 62 65 72 |s....Flo|atnumber|
|00002a80| 73 0d 00 00 00 74 6f 6b | 65 6e 69 7a 65 5f 6c 6f |s....tok|enize_lo|
|00002a90| 6f 70 73 0c 00 00 00 50 | 73 65 75 64 6f 45 78 74 |ops....P|seudoExt|
|00002aa0| 72 61 73 73 08 00 00 00 | 4e 5f 54 4f 4b 45 4e 53 |rass....|N_TOKENS|
|00002ab0| 73 0a 00 00 00 50 6c 61 | 69 6e 54 6f 6b 65 6e 73 |s....Pla|inTokens|
|00002ac0| 03 00 00 00 73 79 73 73 | 08 00 00 00 65 6e 64 70 |....syss|....endp|
|00002ad0| 72 6f 67 73 73 07 00 00 | 00 44 6f 75 62 6c 65 33 |rogss...|.Double3|
|00002ae0| 73 03 00 00 00 61 6e 79 | 73 04 00 00 00 4e 61 6d |s....any|s....Nam|
|00002af0| 65 73 07 00 00 00 43 4f | 4d 4d 45 4e 54 73 0b 00 |es....CO|MMENTs..|
|00002b00| 00 00 5f 5f 63 72 65 64 | 69 74 73 5f 5f 73 05 00 |..__cred|its__s..|
|00002b10| 00 00 67 72 6f 75 70 73 | 06 00 00 00 53 74 72 69 |..groups|....Stri|
|00002b20| 6e 67 73 07 00 00 00 5f | 5f 61 6c 6c 5f 5f 73 0a |ngs...._|_all__s.|
|00002b30| 00 00 00 54 6f 6b 65 6e | 45 72 72 6f 72 73 06 00 |...Token|Errors..|
|00002b40| 00 00 53 69 6e 67 6c 65 | 73 0a 00 00 00 70 72 69 |..Single|s....pri|
|00002b50| 6e 74 74 6f 6b 65 6e 73 | 09 00 00 00 49 6e 74 6e |nttokens|....Intn|
|00002b60| 75 6d 62 65 72 73 02 00 | 00 00 72 65 73 09 00 00 |umbers..|..res...|
|00002b70| 00 4f 63 74 6e 75 6d 62 | 65 72 73 07 00 00 00 74 |.Octnumb|ers....t|
|00002b80| 61 62 73 69 7a 65 73 09 | 00 00 00 74 6f 6b 65 6e |absizes.|...token|
|00002b90| 70 72 6f 67 73 08 00 00 | 00 74 6f 6b 65 6e 69 7a |progs...|.tokeniz|
|00002ba0| 65 73 0f 00 00 00 67 65 | 6e 65 72 61 74 65 5f 74 |es....ge|nerate_t|
|00002bb0| 6f 6b 65 6e 73 73 07 00 | 00 00 53 69 6e 67 6c 65 |okenss..|..Single|
|00002bc0| 33 73 01 00 00 00 74 73 | 06 00 00 00 73 74 72 69 |3s....ts|....stri|
|00002bd0| 6e 67 73 0a 00 00 00 49 | 6d 61 67 6e 75 6d 62 65 |ngs....I|magnumbe|
|00002be0| 72 73 06 00 00 00 44 6f | 75 62 6c 65 73 09 00 00 |rs....Do|ubles...|
|00002bf0| 00 44 65 63 6e 75 6d 62 | 65 72 73 0a 00 00 00 5f |.Decnumb|ers...._|
|00002c00| 5f 61 75 74 68 6f 72 5f | 5f 73 06 00 00 00 49 67 |_author_|_s....Ig|
|00002c10| 6e 6f 72 65 73 05 00 00 | 00 54 6f 6b 65 6e 73 07 |nores...|.Tokens.|
|00002c20| 00 00 00 42 72 61 63 6b | 65 74 73 07 00 00 00 43 |...Brack|ets....C|
|00002c30| 6f 6e 74 53 74 72 73 0a | 00 00 00 70 73 65 75 64 |ontStrs.|...pseud|
|00002c40| 6f 70 72 6f 67 73 02 00 | 00 00 4e 4c 73 0d 00 00 |oprogs..|..NLs...|
|00002c50| 00 73 69 6e 67 6c 65 5f | 71 75 6f 74 65 64 73 08 |.single_|quoteds.|
|00002c60| 00 00 00 45 78 70 6f 6e | 65 6e 74 73 0a 00 00 00 |...Expon|ents....|
|00002c70| 50 6f 69 6e 74 66 6c 6f | 61 74 73 07 00 00 00 43 |Pointflo|ats....C|
|00002c80| 6f 6d 6d 65 6e 74 73 09 | 00 00 00 48 65 78 6e 75 |omments.|...Hexnu|
|00002c90| 6d 62 65 72 73 05 00 00 | 00 6d 61 79 62 65 73 0b |mbers...|.maybes.|
|00002ca0| 00 00 00 64 6f 75 62 6c | 65 33 70 72 6f 67 73 0b |...doubl|e3progs.|
|00002cb0| 00 00 00 73 69 6e 67 6c | 65 33 70 72 6f 67 73 06 |...singl|e3progs.|
|00002cc0| 00 00 00 4e 75 6d 62 65 | 72 73 04 00 00 00 5f 5b |...Numbe|rs...._[|
|00002cd0| 31 5d 73 08 00 00 00 45 | 78 70 66 6c 6f 61 74 73 |1]s....E|xpfloats|
|00002ce0| 05 00 00 00 74 6f 6b 65 | 6e 73 0e 00 00 00 53 74 |....toke|ns....St|
|00002cf0| 6f 70 54 6f 6b 65 6e 69 | 7a 69 6e 67 73 07 00 00 |opTokeni|zings...|
|00002d00| 00 53 70 65 63 69 61 6c | 73 06 00 00 00 54 72 69 |.Special|s....Tri|
|00002d10| 70 6c 65 73 0d 00 00 00 | 74 72 69 70 6c 65 5f 71 |ples....|triple_q|
|00002d20| 75 6f 74 65 64 73 08 00 | 00 00 4f 70 65 72 61 74 |uoteds..|..Operat|
|00002d30| 6f 72 73 01 00 00 00 78 | 28 00 00 00 00 28 00 00 |ors....x|(....(..|
|00002d40| 00 00 73 4b 00 00 00 2f | 4c 69 62 72 61 72 79 2f |..sK.../|Library/|
|00002d50| 46 72 61 6d 65 77 6f 72 | 6b 73 2f 50 79 74 68 6f |Framewor|ks/Pytho|
|00002d60| 6e 2e 66 72 61 6d 65 77 | 6f 72 6b 2f 56 65 72 73 |n.framew|ork/Vers|
|00002d70| 69 6f 6e 73 2f 32 2e 33 | 2f 6c 69 62 2f 70 79 74 |ions/2.3|/lib/pyt|
|00002d80| 68 6f 6e 32 2e 33 2f 74 | 6f 6b 65 6e 69 7a 65 2e |hon2.3/t|okenize.|
|00002d90| 70 79 73 01 00 00 00 3f | 17 00 00 00 73 90 00 00 |pys....?|....s...|
|00002da0| 00 06 02 06 01 06 03 12 | 01 07 02 09 01 52 02 03 |........|.....R..|
|00002db0| 01 03 02 06 01 0a 01 0a | 01 0a 01 0a 02 09 01 09 |........|........|
|00002dc0| 01 09 02 06 01 06 01 1e | 01 06 02 06 01 06 01 06 |........|........|
|00002dd0| 01 12 01 06 01 19 01 0a | 01 0f 01 13 01 12 03 06 |........|........|
|00002de0| 02 06 02 06 02 06 01 0f | 02 06 01 09 05 12 01 03 |........|........|
|00002df0| 01 03 01 09 02 06 01 0f | 01 12 02 15 01 0a 03 13 |........|........|
|00002e00| 02 16 02 12 01 1c 02 2a | 02 f0 0c 06 01 3d 00 06 |.......*|.....=..|
|00002e10| 05 0e 01 06 01 3d 00 06 | 05 0e 02 06 02 16 02 16 |.....=..|........|
|00002e20| 02 09 04 0c 13 09 04 09 | 82 0d 01 09 01 16 00 1e |........|........|
|00002e30| 01                      |                         |.       |        |
+--------+-------------------------+-------------------------+--------+--------+